Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
11 hours ago
Vacancies:
1 Vacancy
Job Summary
Job Title: Senior Data Engineer
Job Location: Hyderabad
Job Type: Full-time
Work Mode: (Hybrid we operate from the office 1 day a week as of now and might change to 2 days depending on the need).
Coeo are trusted data management and analytics experts delivering technology strategy and support for business. The team have deep technical and comraderies experience working with Microsoft Data Services to help our clients optimize their costs and maximize the benefits from their investments in these technologies. Coeo has been established for over 17 years and has offices in Reading UK and Hyderabad India. We are exclusively focused on Microsoft technologies. Our mission is to help our clients predict their future through the better use of data technology people and processes. To do this our business has always focused on:
- Data Managed Services
- Data Platform Consultancy
- Analytics Consultancy
- Artificial Intelligence Consultancy
- Adoption and Change Management
But above all Coeos most important asset is its people and at Coeo we are really focused on investing time attention and resources into building a culture that truly values its people.
We are growing our teams in India to support our ongoing customer requirements in Managed Services Consulting and Development.
Coeo is recruiting a strong Senior Data Engineer; well give you the opportunity to grow and develop your capabilities as well as support you through Microsoft certifications. Youll have experience in:
- Developing low to high complexity secure governed high quality and efficient data pipelines from a variety of on and off premise internal and external data sources.
- Ensuring that data is cleansed mapped transformed and optimized for storage to meet requirements for business and technical use cases.
- Building data observability and data quality by design into all Data pipelines promoting self-testing pipelines that proactively identify processing issues or discrepancies.
- Take all requirements into account when creating a proposal
- Understanding and evaluating the organizational impact of new technologies and digital services
- Troubleshooting and resolving issues
You may be building solutions that transform data into data lake storage areas physical database models and reporting structures across data lakes Datawarehouse business intelligence systems and analytics applications. You may also be required to carry out unit testing of your own code and peer testing of others to ensure appropriate quality.
Experience
- Experience working with large event-based datasets in an enterprise environment.
- Minimum 6 years within anAzureorSQL Data Engineeringenvironment
- Engineering and database skills in SQL Server and/or Azure (Data Factory Synapse) and the associated ETL technologies.
- Experience developing driving & maintaining Data Integration Roadmaps and best practices.
- Overall responsibility of all technical business requirements gathering deliverables and implementation.
- Ability to deliver high-to-low level designs for Data Solutions and have a good understanding of the full data lifecycle.
- Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data FactoryAzure Databricks Azure Synapse Python Pyspark etc.
- Hands-on experience designing and developing stored procedures/functions and leveraging ETL packages/workflows
- Expertise in Cloud related Big Data integration and infrastructure tech stack using Azure Databricks & Apache Spark framework
- Well-versed with scripting languages such as Python
- Experience in Continuous Integration / Continuous Delivery (CI/CD).
- Experience working in an agile environment and self-managing teams.
- Understanding and practical knowledge of testing techniques and tools
Desired Skills
- Big Data
- Azure
- Spark
- Python
- Azure Databricks
- Azure Synapse
- Microsoft Fabric
- Azure Data Factory
- SQL Server
Benefits
- Company bonus scheme driven by yours and our success
- Comprehensive benefits package
- We care about your wellbeing so have invested resources and training help to ensure you can be at your best with us
- Very friendly inclusive culture family-feel and strong camaraderie
- Company growth and new projects mean on going career progression options
- Up to date technology so collaboration has never been easier
- Cutting edge technology projects exciting goals ahead!
Diversity and Inclusion
Coeo is an equal opportunity employer which celebrates Diversity and has a commitment to Inclusion. All applicants will be considered for employment with us without attention to age race color religion sex sexual orientation gender identity national origin and disability status.
How to Apply:
Click Apply or visit our Careers page at. or you can send your resume to
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Our expertise is at the core of everything we do at Coeo. We have more Microsoft Certified Architects and Microsoft Certified Masters for SQL Server than anyone except Microsoft. These are joined by our Microsoft Most Valued Professionals and Microsoft Certified Trainers. With ... View more
