Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailJob Description
BusinessNext is looking for bright and motivated Data Engineers to play a key role in building the next generation Enterprise Big Data Platform.
Responsibilities
Translate business and functional requirements into robust scalable solutions that work well within the overall data architecture.
Develops and maintains scalable data pipelines and builds new API integrations.
Design develop implement test document and operate large scale high volume and low latency applications.
Design data integrations and data quality framework.
Participate in the full development life cycle end-to-end from design implementation and testing to documentation delivery support and maintenance
Experience in working and delivering end-to-end projects independently.
Work Experience
Must have
Excellent knowledge in Python / Java programming.
5 Years development experience in big data using frameworks like Spark Flink Trino etc.
Experience with Dimension Modeling Data Warehousing and building ETL pipelines
Strong expertise in SQL Oracle NoSQL databases like Clickhouse MongoDB and blob storage like MinIO S3 etc.
Knowledge building stream processing platforms using Kafka Spark Streaming Flink
Nice to have
Knowledge of using job orchestration frameworks like Airflow Oozie Luigi etc
Experience with AWS services such as S3 EMR RDS
Good understanding of cloud data warehouses like Snowflake is an added advantage.
Good understanding of SQL distribution engines like Presto (Trino) Druid
Required Experience:
Manager
Full-Time