Palantir Developer

Must Have Technical/Functional Skills We are seeking a skilled Data Engineer with a strong background in data pipeline creation data visualization and analytics. As a key member of our team you will play a crucial role in designing developing and optimizing data solutions to drive actionable insights.

Responsibilities:

1. Data Pipeline Creation:

o Proficiently design develop and maintain data pipelines using the Palantir Foundry tool suite including apps like Slate Workshop Contour Taurus Ontology Manager Object View and Report.

o Utilize JavaScript and Python to create robust data pipelines ensuring efficient data flow and transformation.

2. Data Visualization:

o Develop interactive dashboards using JavaScript providing stakeholders with clear insights into complex datasets.

o Leverage Python for data transformation and visualization enhancing the user experience.

3. Big Data Processing:

o Work on the Azure platform with Databricks developing Spark applications using SparkSQL.

o Extract transform and aggregate data from various file formats (e.g. txt avro parquet csv) to analyze customer data and derive meaningful insights.

4. Spark and PySpark:

o Utilize Spark and PySpark to streamline data processing tasks enhance scalability and optimize performance.

o Design and implement efficient data workflows ensuring data quality and reliability.

5. Machine Learning and Deep Learning:

o Designed regression models and employed ensemble techniques to predict life expectancy achieving a 60% decrease in RMSE compared to the baseline model using gradient boosting regression.

o Proficient in using Spark APIs including Spark SQL Spark DataFrames and UserDefined Functions (UDFs).

o Handson experience with various functions transformations and actions performed on Spark RDDs.

6. Data Modeling and Analysis:

o Imported data onto the Hadoop Distributed File System using MapReduce.

o Analyzed data using Hive and reported insights using Tableau 2020.1.

o Worked with different file formats (Excel CSV Parquet Avro) for Hive querying and processing.

7. Data Visualization Tools:

o Conducted Exploratory Data Analysis (EDA) using Tableau 2020.1 Matplotlib Seaborn (Python) and GGPlot .

o Proficiently designed both logical and physical data models addressing OLTP and OLAP requirements.

8. Version Control and Collaboration:

o Proficiently used Git and GitHub for version control creating and managing branches.

9. Tableau Expertise:

o Generated Tableau visualizations and dashboards using Tableau Desktop.

o Created dashboards with quick filters parameters and sets to handle views more efficiently.

o Combined visualizations into interactive Tableau dashboards and published them to web portals such as Tableau Public.

o Extensively used advanced chart visualizations in Tableau including dualaxis box plots bullet graphs tree maps bubble charts waterfall charts and funnel charts to assist business users in solving complex problems.

Bachelors degree in Computer Science Data Science or a related field.

Proven experience in data engineering data visualization and big data processing.

Strong analytical skills with meticulous attention to detail.

Excellent communication and collaboration skills.

Experience Required 56 years

Roles & Responsibilities We are seeking a skilled Data Engineer with a strong background in data pipeline creation data visualization and analytics. As a key member of our team you will play a crucial role in designing developing and optimizing data solutions to drive actionable insights.

Responsibilities:

10. Data Pipeline Creation:

o Proficiently design develop and maintain data pipelines using the Palantir Foundry tool suite including apps like Slate Workshop Contour Taurus Ontology Manager Object View and Report.

o Utilize JavaScript and Python to create robust data pipelines ensuring efficient data flow and transformation.

11. Data Visualization:

o Develop interactive dashboards using JavaScript providing stakeholders with clear insights into complex datasets.

o Leverage Python for data transformation and visualization enhancing the user experience.

12. Big Data Processing:

o Work on the Azure platform with Databricks developing Spark applications using SparkSQL.

o Extract transform and aggregate data from various file formats (e.g. txt avro parquet csv) to analyze customer data and derive meaningful insights.

13. Spark and PySpark:

o Utilize Spark and PySpark to streamline data processing tasks enhance scalability and optimize performance.

o Design and implement efficient data workflows ensuring data quality and reliability.

14. Machine Learning and Deep Learning:

o Designed regression models and employed ensemble techniques to predict life expectancy achieving a 60% decrease in RMSE compared to the baseline model using gradient boosting regression.

o Proficient in using Spark APIs including Spark SQL Spark DataFrames and UserDefined Functions (UDFs).

o Handson experience with various functions transformations and actions performed on Spark RDDs.

15. Data Modeling and Analysis:

o Imported data onto the Hadoop Distributed File System using MapReduce.

o Analyzed data using Hive and reported insights using Tableau 2020.1.

o Worked with different file formats (Excel CSV Parquet Avro) for Hive querying and processing.

16. Data Visualization Tools:

o Conducted Exploratory Data Analysis (EDA) using Tableau 2020.1 Matplotlib Seaborn (Python) and GGPlot .

o Proficiently designed both logical and physical data models addressing OLTP and OLAP requirements.

17. Version Control and Collaboration:

o Proficiently used Git and GitHub for version control creating and managing branches.

18. Tableau Expertise:

o Generated Tableau visualizations and dashboards using Tableau Desktop.

o Created dashboards with quick filters parameters and sets to handle views more efficiently.

o Combined visualizations into interactive Tableau dashboards and published them to web portals such as Tableau Public.

o Extensively used advanced chart visualizations in Tableau including dualaxis box plots bullet graphs tree maps bubble charts waterfall charts and funnel charts to assist business users in solving complex problems.

Bachelors degree in Computer Science Data Science or a related field.

Proven experience in data engineering data visualization and big data processing.

Strong analytical skills with meticulous attention to detail.

Excellent communication and collaboration skills.