Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
We are building a nextgeneration businesscentric data intelligence and AI foundation that fuels Financefrom FP&A intelligence to product compliance and controllership decisionmaking. As a Data Engineer of the Finance Technology Data Intelligence organization you will architect scalable data pipelines semantic models and endtoend BI solutions while safely operationalizing GenAI capabilities such as RAG prompt engineering evaluation frameworks and agentbased workflows. You will collaborate closely with analysts data scientists and engineering partners to deliver secure reliable auditable and reusable data and AI services that materially enhance decision quality automation and speed across Finance.
Responsibilities:
Build the data foundation
Collaborate with Data Analysts Data Scientists Software Engineers and cross-functional partners to design build and deploy scalable data pipelines that deliver highquality governed analytical datasets across Finance domains.
Engineer highquality batch/streaming data pipelines (SQL/Hive/PySpark) across Lake/Lakehouse to power curated finance domain marts and a governed semantic layer.
Design dimensional/semantic models that enable selfservice analytics (PowerBI / Fabric semantic models / SSAS Tabular) with performant DAX measures and rowlevel security.
Operationalize GenAI for Finance
Ship productiongrade GenAI features (retrievalaugmented generation promptchaining/agents) on governed datasets - implement vectorization strategies and chunking that respect PII/SOX controls.
Partner with DS/ML to train/finetune and evaluate models - harden prompt templates guardrails and content filters - track hallucination toxicity and retrieval metrics (precision/recall ).
Build reusable components (prompt libraries evaluation harnesses vector store abstractions) and integration SDKs/APIs for reuse across Finance use cases.
Platform reliability & DevOps
Implement CI/CD for data & AI (Git Azure DevOps/GitHub Actions) data quality tests (Great Expectations or equivalent) and model/data deployment automation (MLflow/Fabric/Azure ML).
Define observability (lineage drift freshness cost) with alerts/SLAs - drive continuous hardening for performance (SQL/DAX tuning) cost efficiency and reliability.
Analytics enablement
Deliver highimpact dashboards/scorecards (PowerBI/Tableau) and governed certified datasets - coach analysts on bestpractice modeling and performance tuning.
Risk governance & documentation
Embed privacybydesign (PII masking purpose limitation) finance controls (SOX audit trails) and robust documentation (runbooks data dictionaries model cards).
This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.
Qualifications :
Basic Qualifications:
- Bachelors degree OR 3 years of relevant work experience
Preferred Qualifications:
- Bachelors degree OR 3 years of relevant work experience
- Bachelors degree in Engineering with Honors in Data Science or Computer Science is required along with 1 years of hands-on experience building large scale data processing platforms
- Strong understanding of data warehousing concepts including ER data modeling data warehouse architecture feature engineering and solid knowledge of the Big Data ecosystem and its 5 Vs.
- 1 years of practical experience using SQL/Hive/PySpark for data extraction aggregation optimization and storage on Hadoop technologies (Spark Tez MR) and cloud platforms
- 1 years of applied GenAI engineering experience including production grade GenAI features such as RAG over enterprise data prompt engineering evaluation guardrails and familiarity with LLMs vectorization chunking and orchestration frameworks (LangChain).
- Ability to build reusable componentsincluding prompt libraries evaluation frameworks vector store abstractionsand integration SDKs/APIs to enable reuse across Finance scenarios.
- 1 years of hands-on experience delivering end to end Business Intelligence solutions with an understanding of ETL strategies and the ability to contribute to data model decisions for reporting.
- Working knowledge of Machine Learning Deep Learning GenAI and MLOps is a strong advantage.
- Familiarity with Data administration (YARN Splunk Profiler Perfmon security architecture user provisioning audit etc.) is preferred.
- Exposure to Finance Data Analytics or finance domain is an added advantage.
Additional Information :
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Visa (NYSE: V) is a world leader in digital payments, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories. Our purpose is to uplift everyone, everywhere by being the best way to pay and b ... View more
