Data Architect

Saransh Inc

Job Location:

New York City, NY - USA

Monthly Salary: Not Disclosed

Posted on: 5 hours ago

Vacancies: 1 Vacancy

Job Summary

Hands-on Data Architect (Databricks Lakehouse)Role OverviewOwn the target-state architecture in Databricks and actively contribute to pipeline development. Define how API/FTP data flows into Bronze/Silver/Gold layers with cleansing and enrichment ResponsibilitiesDesign Databricks Lakehouse architecture (Bronze/Silver/Gold)Define ingestion patterns for API & FTPArchitect scalable cleansing & enrichment frameworksTranslate legacy SQL logic into Spark-based transformationsDefine Delta Lake optimization strategyEstablish security governance and PHI controlsImplement CI/CD for data pipelinesMentor engineering teamRequired SkillsStrong expertise in Databricks & Delta LakeAdvanced PySpark & Spark SQLExperience designing data pipelines from scratchStrong understanding of SQL Server logic & stored proceduresAzure cloud experienceHealthcare data architecture experience preferred