Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Location:
Chennai Tamil Nadu IndiaJob ID:
R0113012Date Posted:
Company Name:
HITACHI ENERGY TECHNOLOGY SERVICES PRIVATE LIMITEDProfession (Job Category):
Engineering & ScienceJob Schedule:
Full timeRemote:
NoJob Description:
The opportunity:
As a Data Engineer you will be part of Operation Center India (INOPC-PG) aiming to develop a global value chain where key business activities resources and expertise are shared across geographic boundaries to optimize value for Hitachi Energy customers across markets. As part of Transformers BU we provide high-quality engineering and Technology to Hitachi Energy world. This is an important step from Hitachi Energys Global Footprint strategy.
How youll make an impact:
Display technical expertise in data analytics focusing on a team of diversified technical competencies.
Build and maintain accurate and scalable data pipeline and infrastructure such as SQL Warehouse Data Lakes etc. using Cloud platforms (e.g.: MS Azure Databricks).
Proactively work with business stakeholders to understand data lineage definitions and methods of data extraction. Write production-grade SQL and PySpark code to create data architecture.
Consolidate SQL databases from multiple sources data cleaning and manipulation in preparation for analytics and machine learning.
Use data visualization tools such as Power BI to create professional quality dashboards and reports.
Write good quality documentation for data processing for different projects to ensure reproducibility.
Responsible to ensure compliance with applicable external and internal regulations procedures and guidelines.
Living Hitachi Energys core values safety and integrity which means taking responsibility for your own actions while caring for your colleagues and the business.
Your background:
Bachelors degree in computer science Data Science or related discipline and at least 5 years of related working experience.
5 years of data engineering experience with understanding lake house architecture data integration framework ETL/ELT pipeline orchestration/monitoring star schema data modeling.
5 years of experience with Python/PySpark and SQL. (Proficient in PySpark Python and Spark SQL). 2-3 years of hands-on data engineering experience using Databricks as the main tool (meaning >60% of their time is using Databricks instead of just occasionally).
2-3 years of hands-on experience with different Databricks components (DLT workflow Unity catalog SQL warehouse CI/CD) in addition to using notebooks. Experience in Microsoft Power BI.
Basic understanding of Machine Learning algorithms. AI/ML can automate and improve data processing tasks making them more efficient and accurate.
Integrating AI/ML can help in building predictive models that can forecast trends and outcomes providing valuable insights for decision-making. AI/ML can be used to create personalized experiences for users by analyzing their behavior and preferences.
AI/ML can automate repetitive tasks freeing up time for more complex and creative work. Ability to quickly grasp concepts from a field that is not ones core competency.
A fast learning generalist capable of solving problems independently and resourceful in a matrixed corporate environment.
Proficiency in both spoken & written English language is required.
Qualified individuals with a disability may request a reasonable accommodation if you are unable or limited in your ability to use or access the Hitachi Energy career site as a result of your disability. You may request reasonable accommodations by completing a general inquiry form on our website. Please include your contact information and specific details about your required accommodation to support you during the job application process.
This is solely for job seekers with disabilities requiring accessibility assistance or an accommodation in the job application process. Messages left for other purposes will not receive a response.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Discover how Hitachi Rail is connecting the future of mobility through integrated rail solutions, across rolling stock, signalling, digital technology and more.
