Data Engineer
Job Location:
Bengaluru Urban - India
Monthly Salary:
Experience Required:
Posted:
Application Deadline:
Vacancies:
Job Summary
This is a remote position.
Data Engineering @ PEOPLE10
Role: Data Engineer
Job Location: Bangalore (Remote)
Shift : 1pm to 10pm IST
Experience
34 years of hands-on experience in Data Engineering ETL/ELT data integration and building data pipelines.
Experience working with cloud-based data platforms and modern data architectures.
Core Technical Skills
SQL: Strong SQL skills including joins CTEs window functions aggregations transformations and query optimization.
Python: Experience with Python for data processing automation and pipeline development including debugging and error handling.
Data Engineering: Good understanding of ETL/ELT batch and incremental processing data modeling data quality validation and reconciliation.
Cloud: Hands-on experience with AWS Azure or GCP including cloud storage compute and access management.
Data Warehouse: Experience with Snowflake preferred; alternatively Databricks Redshift Synapse or BigQuery. Understanding of data loading transformation and performance optimization.
Integration: Experience integrating databases APIs SaaS applications files and cloud storage. Knowledge of REST APIs JSON authentication and error handling.
Orchestration: Experience with tools such as Airflow Azure Data Factory AWS Glue or equivalent. Exposure to dbt is preferred.
Streaming: Basic exposure to Kafka Kinesis Event Hubs or other event-driven/real-time processing technologies is preferred.
Engineering Practices: Experience with Git logging monitoring troubleshooting and production support. Exposure to CI/CD and Docker is an advantage.
Key Responsibilities
Work closely with the Data Engineering Lead to implement the target data architecture.
Develop and maintain scalable data ingestion and transformation pipelines.
Integrate data from databases APIs SaaS applications files and cloud platforms.
Implement data validation quality checks reconciliation and monitoring.
Perform source data analysis and troubleshoot pipeline data and performance issues.
Support POCs technical evaluations testing UAT deployments and production stabilization.
Participate in code reviews and maintain technical documentation.
Take ownership of assigned components and contribute to end-to-end solution delivery.
Preferred
Experience with Snowflake and modern cloud data architectures.
Exposure to streaming/event-driven architectures.
Understanding of analytical data modeling and datasets for reporting and self-service analytics.
Good communication and problem-solving skills with the ability to work independently while collaborating closely with the Lead.
Why Join People10
At People10 you will be immersed in an exceptional work environment surrounded by helpful colleagues and a workplace where feedback flows freely. If youre looking to make an impact People10 is the place for you. People10 is an equal opportunity employer. We welcome and encourage diversity in the workplace regardless of race gender religion age sexual orientation gender identity disability or veteran status. Our culture of open door policy constant connection with leadership team opportunities for skill development through diversified learning initiatives like code combat meetups knowledge booster sessions makes People10 an rewarding place to People10 we dont just build software but we also build careers. You will be: Be part of a growing design-led digital transformation firm solving real tech problems.
Collaborate with smart driven teammates across geographies.
Enjoy autonomy creative freedom and the opportunity to make a visible impact.
Learn upskill and lead we believe in growing people alongside platforms.
We would love to meet you if you are ready to take initiative and make your mark in a high-impact marketing role.
About People10:
People10 is a new-age Agile and Lean Product Engineering firm that empowers businesses to be fast-and
fail-proof through state-of-the-art IT solutions. We craft custom solutions in web mobile cloud and data analytics using rapid agile and lean engineering methods and productivity frameworks.
Great Place to Work Certified.
Great Place to Work Certified.
Great Place to Work Certified.
Rated Best Software Development Agency in New York City - Expertise (2021)
Rated Top Software Development Company - Clutch New York (2020)
Rated Top Software Development Company - Clutch New York (2019)
60 clients and 350 projects
250 employees and expanding quickly
A work environment that inspires people to collaborate and do great work on cutting edge technologies
For more information please visit
Required Skills:
Roles & Responsibilities Solution Design & Architecture Design end-to-end data architectures including ingestion transformation storage and consumption layers. Evaluate and propose scalable cloud-native platform solutions. Create data models data flow diagrams and architecture blueprints. Cloud Data Engineering Build and optimize ETL/ELT pipelines using cloud-native services (Azure Data Factory AWS Glue GCP Dataflow). Implement real-time streaming pipelines using Kafka Event Hubs Kinesis or Pub/Sub. Develop scalable data lakes lakehouses and warehouses (Delta Lake BigQuery Redshift Snowflake). Work with cloud functions serverless compute and event-driven architectures. Data Processing & Modeling Transform and process large datasets using Spark Databricks PySpark or SQL engines. Implement batch and streaming workflows for analytics or AI/ML consumption. Ensure data quality lineage auditing and governance best practices. Collaboration & Solutioning Participate in requirement gathering meetings and customer workshops as a data engineering expert. Work closely with the client team to understand the enterprise landscape to come up with DataModel Support team members by reviewing designs and unblocking technical issues. Operationalization Build CI/CD pipelines for data components and automate deployment workflows. Implement cost optimization scalability and performance tuning for cloud data workloads. Ensure security best practices across identity data encryption access control and network design. What Were Looking For Technical Skills Strong programming skills in Python or Scala SQL and data transformation logic. Hands-on experience with cloud-native data services including: Azure: Data Factory Synapse Databricks Event Hub AWS: Glue EMR Redshift Kinesis Lambda GCP: Dataflow DataProc BigQuery Pub/Sub Experience with Spark / PySpark distributed data processing and pipeline performance tuning. Proficiency with data modeling schema design star/snowflake models. Strong knowledge of data lake / lakehouse architectures (Delta Lake Iceberg Hudi). Experience with streaming frameworks (Kafka Event Hub Kinesis). Familiarity with containerization (Docker) and CI/CD (GitHub Actions Azure DevOps etc.). Knowledge of security: IAM VNet encryption governance. Professional Skills Ability to translate business needs into scalable data solutions. Strong documentation diagramming and solution presentation skills. Comfortable in technical demonstrations. Good-to-Have Skills Experience with Snowflake Databricks advanced features (Unity Catalog). Familiarity with event-driven microservices and API development. Understanding of data observability tools (Great Expectations Monte Carlo). Experience working in multi-cloud hybrid environments.
