Senior Lead, Data Engineering

We are looking for a Senior Lead Data Engineering to join our growing team! In this role you will play a key technical leadership role in the development of robust scalable data pipelines and cloud-based data solutions to support enterprise-wide analytics and reporting. You are a highly technical individual contributor position with informal leadership responsibilities and architectural influence. You will lead the design and implementation of batch and real-time data pipelines using modern platforms such as Google Cloud Platform (GCP) BigQuery Informatica Hive and Spark. Working closely with cross-functional teams youll turn data into actionable insights while also mentoring peers and ensuring engineering best practices are followed.

As a Senior Lead Data Engineering your duties and responsibilities will include:

• Design and implement efficient reliable ETL/ELT pipelines for structured and unstructured data across cloud and on-prem environments
• Build and maintain streaming and batch data pipelines using technologies like Kafka Spark and Dataflow
• Develop data solutions that integrate with enterprise data warehouses (e.g. BigQuery Snowflake Hive) and data lakes
• Lead technical designs for ETL architecture including data models workflow orchestration and performance optimization
• Create scalable reusable code and frameworks incorporating monitoring exception handling and version control
• Collaborate with business analysts data scientists and engineering teams to translate business needs into effective data solutions
• Support data governance and ensure data quality consistency and compliance with internal standards
• Act as a technical mentor and guide for junior team members and data engineers
• Proactively identify and resolve performance bottlenecks or design inefficiencies in data pipelines

Qualifications :

WHAT IT TAKES TO CATCH OUR EYE:

• Bachelors degree in Computer Science Engineering Information Systems or a related field
• 8 years of hands-on experience in data engineering with significant experience in cloud and distributed data platforms
• Strong experience with Informatica Hive Spark Kafka and Python
• Proficiency in Google Cloud Platform (GCP) services (especially BigQuery Pub/Sub and Dataflow)
• Experience designing solutions using data warehouse modeling techniques (e.g. Star Schema snowflake schema)
• Familiarity with orchestration tools such as Cloud Composer or Airflow.
• Strong SQL skills and experience working with large-scale datasets
• Excellent problem-solving skills ability to navigate ambiguity and a high degree of initiative
• Ability to communicate complex technical concepts clearly to technical and non-technical audiences
• Experience in telecommunications or other high-data-volume industries 

BONUS POINTS FOR:

• GCP Professional Data Engineer certification or similar cloud certification
• Experience with DataOps practices and CI/CD for data pipeline deployment
• Experience in managing or supporting Hadoop ecosystems and cloud data migration
• Knowledge of data security scalability and system performance tuning
• Background in supporting machine learning workflows or feature engineering pipelines

#LI-SS1

Additional Information :

WHY JOIN US

We aspire to contemporary ways of working.

Recognized as a Top Workplace by the Charlotte Observer Brightspeed HQ is located on the 7th floor of the new Vantage South End - East Tower in Charlotte NC. We prioritize hiring talent in the Charlotte area whenever possible to make it a truly vibrant destination for our hybrid workforce. At Brightspeed we have roles that are designated as remote hybrid office or field-based depending on the position business needs and individual circumstances. We also invest in technology that enables our entire team to stay connected. Why Because Brightspeed recognizes the value of finding the best talent for the job wherever they may be.

We offer competitive compensation and comprehensive benefits.

Our benefits and paid time off programs reflect our underlying belief in promoting overall wellness through physical emotional and financial health. Brightspeed offers a comprehensive benefit program including competitive medical dental vision and life insurance; an employee assistance program; a 401K plan with company match and a host of voluntary benefits. 

Inclusion and belonging are at the center of our grounding belief in Being Real. 

When we bring our authentic selves to work everyone is better as a result. A diverse team helps us be fierce advocates for more accessible inclusive and high-quality internet because we believe doing so promotes equity in the communities we serve.

Brightspeed is an Equal Opportunity Employer that is committed to inclusion of all qualified individuals including individuals with a disability/veterans. If you require reasonable accommodation to complete a job application or to otherwise participate in the hiring process please contact to initiate the accommodations process. 

For all applicants please take a moment to review our Privacy Notices:  

• Brightspeeds Privacy Notice for California Residents
• Brightspeeds Privacy Notice