Senior Data Engineer 123012
Senior Data Engineer 123012
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Location: Pune
Work mode: Hybrid
What do we do
As a pioneer for digital transformation GFT develops sustainable solutions across new technologies from cloud engineering and artificial intelligence to blockchain/DLT. With its deep technological expertise strong partnerships and comprehensive market knowhow GFT offers advice to the financial and insurance sectors as well as in the manufacturing industry. Through the intelligent use of IT solutions GFT increases productivity and creates added value for clients. Companies gain easy and safe access to scalable IT applications and innovative business models.
Who are we
Having started in Germany in 1987 GFT Technologies has grown to become a trusted Software Engineering and Consulting specialist for the international financial industry counting many of the worlds largest and bestknown Banks as our clients. We are an organization that empowers you to not only explore but raise your potential and seek out opportunities that add value. At GFT diversity equality and inclusion are at the core of who we are. Ensuring a diverse and inclusive working environment for all communities is one of the main pillars of our diversity strategy based on our core values and culture. We have been certified for 2022/23 as a Great place to work in the APAC region. So if you want to have the opportunity to work with an outstanding and progressive organization this position could be right for you.
As a Senior Data Engineer at GFT you will play a pivotal role in designing maintaining and enhancing various analytical and operational services and infrastructure crucial for the organizations functions. Youll collaborate closely with crossfunctional teams to ensure the seamless flow of data for critical decisionmaking processes.
Key Activities
- Data Infrastructure Design and Maintenance: Architect maintain and enhance analytical and operational services and infrastructure including data lakes databases data pipelines and metadata repositories to ensure accurate and timely delivery of actionable insights
- Collaboration: Work closely with data science teams to design and implement data schemas and models integrate new data sources with product teams and collaborate with other data engineers to implement cuttingedge technologies in the data space
- Data Processing: Develop and optimize largescale batch and realtime data processing systems to support the organizations growth and improvement initiatives
- Workflow Management: Utilize workflow scheduling and monitoring tools like Apache Airflow and AWS Batch to ensure efficient data processing and management
- Quality Assurance: Implement robust testing strategies to ensure the reliability and usability of data processing systems
- Continuous Improvement: Stay abreast of emerging technologies and best practices in data engineering and propose and implement optimizations to enhance development efficiency
Required Skills
- Technical Expertise: Proficient in Unix environments distributed and cloud computing Python frameworks (e.g. pandas pyspark) version control systems (e.g. git) and workflow scheduling tools (e.g. Apache Airflow)
- Database Proficiency: Experience with columnar and big data databases like Athena Redshift Vertica and Hive/Hadoop
- Cloud Services: Familiarity with AWS or other cloud services like Glue EMR EC2 S3 Lambda etc.
- Containerization: Experience with container management and orchestration tools like Docker ECS and Kubernetes
- CI/CD: Knowledge of CI/CD tools such as Jenkins CircleCI or AWS CodePipeline
Nicetohave requirements
- Programming Languages: Familiarity with JVM languages like Java or Scala
- Database Technologies: Experience with RDBMS (e.g. MySQL PostgreSQL) and NoSQL databases (e.g. DynamoDB Redis)
- BI Tools: Exposure to enterprise BI tools like Tableau Looker or PowerBI
- Data Science Environments: Understanding of data science environments like AWS Sagemaker or Databricks
- Monitoring and Logging: Knowledge of log ingestion and monitoring tools like ELK stack or Datadog
- Data Privacy and Security: Understanding of data privacy and security tools and concepts
- Messaging Systems: Familiarity with distributed messaging and event streaming systems like Kafka or RabbitMQ
What we offer you
You will be working with some of the brightest people in business and technology on challenging and rewarding projects in a team of likeminded individuals. GFT prides itself on its international environment that promotes professional and cultural exchange and encourages further individual development.
Required Experience:
Senior IC
Employment Type
Full Time
