Job Title: Technical Data Architect
Location: New York NY / Tampa FL - Onsite
Only FTE
Required Qualifications
- Bachelors or masters degree in computer science Engineering or a related quantitative field.
- 15 years of progressive experience in software engineering with at least 5 years in a Technical Architect Lead Data Architect or Principal Data Engineer role specifically focused on data quality data governance or data platform architecture.
- Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem:
- Apache Spark (PySpark Scala or Java): Expert-level experience with Spark SQL DataFrames/Datasets streaming and advanced performance tuning techniques.
- Distributed Storage & Processing: Hadoop HDFS S3 Delta Lake Apache Iceberg or similar data lake technologies.
- Streaming Technologies: Apache Kafka AWS Kinesis or similar high-throughput messaging systems.
- Cloud Data Platforms: Extensive experience designing and implementing solutions on AWS (e.g. EMR Glue Redshift Lambda Step Functions S3) Azure (e.g. Databricks Synapse Analytics Data Lake Storage) or GCP (e.g. Dataproc BigQuery Cloud Storage).
- Expert-level hands-on experience with Advanced SQL for complex data analysis validation and optimization.
- Expert-level hands-on experience with Python for data engineering automation and developing robust data quality solutions.
- Proven track record of defining designing and implementing large-scale data automation frameworks.
- Demonstrated expertise in data quality engineering principles methodologies and tools (profiling validation cleansing reconciliation anomaly detection).
- Experience in leading and mentoring technical teams fostering a culture of technical excellence and continuous improvement.
- Strong understanding of software development lifecycle (SDLC) DevOps practices and integrating quality gates into CI/CD pipelines.
- Excellent communication presentation and interpersonal skills with the ability to articulate complex technical concepts to diverse audiences including senior leadership and non-technical stakeholders.