Data and Analytics Architect-L1
Data and Analytics Architect-L1
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Data and Analytics Architect-L1
Job Description
The purpose of the role is to define and develop Enterprise Data Structure along with Data Warehouse Master Data Integration and transaction processing with maintaining and strengthening the modelling standards and business information.
Key Responsibilities:
Build and optimize Prophecy data pipelines for large scale batch and streaming data workloads using Pyspark
Define end-to-end data architecture leveraging prophecy integrated with databricks or Spark or other cloud-native compute engines
Establish coding standards reusable components and naming conventions using Prophecys visual designer and metdata-driven approach
Implement scalable and efficient data models (e.g star schema scd typ2) for data marts and analytics layer
Integrate Prophecy pipelines with orchestration tools like Airflow data catalog tools for lineage
Implement version control automated testing and deployment pipelines using Git and CI/CD (e.g GitHub and Jenkins)
Monitor and tune performance of Spark jobs optimize data partitions and caching strategies
Having experience and exposure to convert legacy etl tools like datastage informatica into Prophecy pipelines using Transpiler component of Prophecy
Required skill & experience:
2 years of hands-on experience with Prophecy (Using pyspark) approach
5 years of experience in data engineering with tools such as Spark Databricksscala/Pyspark or SQL
Strong understanding of ETL/ELT pipelines distributed data processing and data lake architecture.
Having exposure to ETL tools such as Informatica Datastage or talend is added advantage
Experience with Unity catalog Delta lake and modern data lakehouse concepts
Strong communication and stakeholder management skills.
p. Collecting aggregating matching consolidating quality-assuring persisting and distributing such data throughout an organization to ensure a common understanding consistency accuracy and control
q. Provide solution of RFP s received from clients and ensure overall implementation assurance
i. Develop a direction to manage the portfolio of all the databases including systems shared infrastructure services in order to better match business outcome objectives
ii. Analyse technology environment enterprise specifics client requirements to set a collaboration solution for the big/small data
iii. Provide technical leadership to the implementation of custom solutions through thoughtful use of modern technology
iv. Define and understand current issues and problems and identify improvements
v. Evaluate and recommend solutions to integrate with overall technology ecosystem keeping consistency throughout
vi. Understand the root cause problem in integrating business and product units
vii. Validate the solution/ prototype from technology cost structure and customer differentiation point of view
viii. Collaborating with sales and delivery leadership teams to identify future needs and requirements
ix. Tracks industry and application trends and relates these to planning current and future IT need
2. Building enterprise technology environment for data architecture management
a. Develop maintain and implement standard patterns for data layers data stores data hub & lake and data management processes
b. Evaluate all the implemented systems to determine their viability in terms of cost effectiveness
c. Collect all the structural and non-structural data from different places integrate all the data in one database form
d. Work through every stage of data processing: analysing creating physical data model designs solutions and reports
e. Build the enterprise conceptual and logical data models for analytics operational and data mart structures in accordance with industry best practices
f. Implement the best security practices across all the data bases based on the accessibility and technology
g. Strong understanding of activities within primary discipline such as Master Data Management (MDM) Metadata Management and Data Governance (DG)
h. Demonstrate strong experience in Conceptual Logical and physical database architectures design patterns best practices and programming techniques around relational data modelling and data integration
3. Enable Delivery Teams by providing optimal delivery solutions/ frameworks
a. Build and maintain relationships with delivery and practice leadership teams and other key stakeholders to become a trusted advisor
b. Define database physical structure functional capabilities security back-up and recovery specifications
c. Develops and establishes relevant technical business process and overall support metrics (KPI/SLA) to drive results
d. Monitor system capabilities and performance by performing tests and configurations
e. Integrate new solutions and troubleshoot previously occurred errors
f. Manages multiple projects and accurately reports the status of all major assignments while adhering to all project management standards
g. Identify technical process structural risks and prepare a risk mitigation plan for all the projects
h. Ensure quality assurance of all the architecture or design decisions and provides technical mitigation support to the delivery teams
i. Recommend tools for reuse automation for improved productivity and reduced cycle times
j. Help the support and integration team for better efficiency and client experience for ease of use by using AI methods.
k. Develops trust and builds effective working relationships through respectful collaborative engagement across individual product teams
l. Ensures architecture principles and standards are consistently applied to all the projects
m. Ensure optimal Client Engagement
i. Support pre-sales team while presenting the entire solution design and its principles to the client
ii. Negotiate manage and coordinate with the client teams to ensure all requirements are met
iii. Demonstrate thought leadership with strong technical capability in front of the client to win the confidence and act as a trusted advisor
Mandatory Skills: .
Experience: 8-10 Years .
Prophecy AI AI-Powered Sports Betting Predictions
Prophecy AI - Advanced sports betting predictions powered by artificial intelligence. Get winning picks and expert analysis for NFL NBA MLB and more.
Employment Type
Full Time
