We are looking for12 years experienced highly skilled Senior Lead Software Engineer (QA) with Experience in Azure (Databricks ADLS ADF Synapse) and/or AWS (Glue S3 Redshift) Good in Design scalable architectures (Lakehouse). Experience in building and optimizing data pipelines using Spark Databricks ADF Glue.t orchestration Model Context Protocol any frameworks or tools related to evaluations and ML observability. (Including and not limited to Langsmith).Advanced SQL for transformations and validations.. Expertise in dimensional modeling Data Vault and canonical models. Define data vision roadmap and governance policies. RBAC/ABAC encryption secrets management. Audit readiness and regulatory compliance. Audit readiness and regulatory scalability performance tuning and cost optimization. Deep knowledge of Azure (Databricks ADLS Synapse) or AWS (Glue Redshift). Work with data engineers QA platform teams to ensure delivery. Support feature store design and RAG pipelines for GenAI use cases. Snowflake/Synapse/Redshift Lake Formation glue catalogs; portability considerations. Feature store strategy curated ML-ready datasets RAG data pipelines over governed Lake maintenance (OPTIMIZE/VACUUM) schema evolution time travel multihop Medallion architecture..
We are looking for12 years experienced highly skilled Senior Lead Software Engineer (QA) with Experience in Azure (Databricks ADLS ADF Synapse) and/or AWS (Glue S3 Redshift) Good in Design scalable architectures (Lakehouse). Experience in building and optimizing data pipelines using Spark Databricks...
We are looking for12 years experienced highly skilled Senior Lead Software Engineer (QA) with Experience in Azure (Databricks ADLS ADF Synapse) and/or AWS (Glue S3 Redshift) Good in Design scalable architectures (Lakehouse). Experience in building and optimizing data pipelines using Spark Databricks ADF Glue.t orchestration Model Context Protocol any frameworks or tools related to evaluations and ML observability. (Including and not limited to Langsmith).Advanced SQL for transformations and validations.. Expertise in dimensional modeling Data Vault and canonical models. Define data vision roadmap and governance policies. RBAC/ABAC encryption secrets management. Audit readiness and regulatory compliance. Audit readiness and regulatory scalability performance tuning and cost optimization. Deep knowledge of Azure (Databricks ADLS Synapse) or AWS (Glue Redshift). Work with data engineers QA platform teams to ensure delivery. Support feature store design and RAG pipelines for GenAI use cases. Snowflake/Synapse/Redshift Lake Formation glue catalogs; portability considerations. Feature store strategy curated ML-ready datasets RAG data pipelines over governed Lake maintenance (OPTIMIZE/VACUUM) schema evolution time travel multihop Medallion architecture..
View more
View less