Senior Software Engineer
Job Location:
Monthly Salary:
Experience Required:
Posted on:
Vacancies:
Job Summary
Who are we
Fulcrum Digital is an agile and next-generation digital accelerating company providing digital transformation and technology services right from ideation to implementation. These services have applicability across a variety of industries including banking & financial services insurance retail higher education food healthcare and manufacturing.
Requirements
As a Senior Software Engineer on the DataPipeline team you will provide technical leadership and hands-on delivery. This role is designed for an experienced practitioner who can operate independently in complex problem spaces accelerate delivery of critical capabilities and raise the technical bar across the platform through architecture implementation and mentorship.
Position Responsibilities
As a Senior Software Engineer focused on the Data Pipeline you will:
- Own and deliver complex end-to-end data platform capabilities from ingestion and processing through publishing.
- Act as a senior technical contributor for the data layer influencing architecture decisions and ensuring alignment across multiple products.
- Design and evolve highly scalable reliable and observable data pipelines.
- Lead resolution of complex technical problems including performance bottlenecks data quality issues and production incidents.
- Maintain strong engineering standards for pipeline development including design patterns testing strategies documentation and operational excellence.
- Drive reduction of technical debt balancing short-term delivery needs with long-term platform health and sustainability.
- Partner closely with Product Managers and Data Scientists to translate ambiguous business and analytical needs into clear durable technical solutions.
- Mentor and support other engineers through code reviews design discussions and knowledge sharing.
Ideal Candidate Qualifications
- Extensive professional experience building and operating production-grade systems in Python (required).
- Advanced SQL expertise including query optimization and modeling for very large datasets (required).
- Proven experience designing and delivering large-scale data pipelines or data platform components.
- Strong working experience with Databricks or similar Spark-based data processing platforms.
- Demonstrated ability to own systems in production including observability troubleshooting and incident response.
- Deep understanding of software design principles data modeling and engineering best practices.
- Comfortable using LLM-based coding tools responsibly with full ownership for correctness testing and maintainability of resulting code.
- Excellent written and verbal English communication skills with the ability to clearly explain complex technical topics to varied audiences.
Nice to have:
- Experience with workflow orchestration tools (e.g. Airflow).
- Prior experience working in analytics economic data or large-scale data products.
Required Skills:
Understanding of event-driven architectures Distributed systems - How clusters are formed Quorum management Failure handling. 3 to 5 years of hands-on Experience in MQ or NATS broker or similar messaging solutions. Understanding of Kafka clustering would be good to have. Knows Client-Server communication aspects - sockets TLS protocol etc Understands the concept of region and AZs. Provide L2 support production systems like application database middleware components infrastructure and network components. Manage production incidents end-to-end within defined SLAs with focus on resolution rather than who caused it. Interact with various stakeholders such as Release managers program leads service managers development and test leads Review operational readiness requirements such as monitoring and alerting log rotation and resilience of the components and report the gaps Provide pre-implementation support with activities such as release notes review and implementation dry runs. Protect production components by running health checks monitoring latency and memory utilization. Automate day-to-day activities and propose changes that improve reliability Participate in CAB and provide feedback on change requests Support the DevOps team in testing the promoted pipelines and suggest automation of configuration items. Practice incident management best practices and perform RCA. Participate in disaster recovery tests and operational acceptance tests Analyze the technology stack that makes up the product and optimize recovery time objective. Work with team members spread across and time zones Share knowledge document improvements and mentor junior resources It is good to have skills using Jenkins to orchestrate builds and link to Sonar Maven etc. to build out the CI/CD pipeline. Support deployments of code into multiple lower environments. Supporting current processes needed with an emphasis on automating everything as soon as possible. It is good to have skill to design Implement and enhance our deployment automation based on Chef. We need proven experience designing and implementing an overall release and deployment process. It is good to have skill to design and implement a Git based code management strategy that will support multiple environment deployments in parallel. Experience with automation for Branch management code promotions and version management. Engage in and improve the whole lifecycle of servicesfrom inception and design through deployment operation and refinement. Requirements MQ/EB Understanding of event-driven architectures Distributed systems - How clusters are formed Quorum management Failure handling. 3 to 5 years of hands-on Experience in MQ or NATS broker or similar messaging solutions. An understanding of Kafka clustering would be good to have. Knows Client-Server communication aspects - sockets TLS protocol etc Understand the concept of region and AZs. Deployments MTF/Prod Maintenance items (including stop/start Disaster Recovery-related activities etc.) CR for changes in MTF/Prod Good knowledge on Nginx Tools - Log Monitoring Tool - Splunk Application Monitoring tool - Dynatrace Ticketing incident/problem management tool - Remedy Dev-ops Basics - CI-CD Basics Overview of Git Bit-bucket SonarQube Ansible/Chef Skills - Linux & Shell Scripting ITIL / ITSM PL/SQL Troubleshooting Jenkins - CI/CD Groovy Scripting/Yaml Ansible/Chef Nginx Java / JEE Event-Driven Architectures MQ or NATS broker or similar messaging solutions. Kafka Client-server communication aspects - sockets TLS protocol Understand the concept of region and AZs.
