Java NIFI Technical SME
Share
Job Location:
Phoenix, NM - USA
Monthly Salary:
Not Disclosed
Posted on:
9 hours ago
Vacancies:
1 Vacancy
Job Summary
Java NIFI Technical SME
ONSITE- Raleigh NC/Phoenix AZ
Hire Type: Contract
ONSITE- Raleigh NC/Phoenix AZ
Hire Type: Contract
Strong NiFi Expertise: Deep understanding of NiFi architecture processors controllers and data flow management capabilities.
Data Integration and ETL: Experience with data integration ETL processes and data modeling concepts.
Programming Languages: Proficiency in Java Python or other relevant scripting languages.
Database and SQL: Familiarity with databases SQL and data manipulation techniques.
Big Data Technologies: Knowledge of big data technologies like Kafka.
Data Integration and ETL: Experience with data integration ETL processes and data modeling concepts.
Programming Languages: Proficiency in Java Python or other relevant scripting languages.
Database and SQL: Familiarity with databases SQL and data manipulation techniques.
Big Data Technologies: Knowledge of big data technologies like Kafka.
Design and Implementation:
o Creating and implementing data flow solutions using NiFi including defining data sources destinations and transformation processes.
Ingestion and Transformation:
o Managing data ingestion from various sources (e.g. files databases APIs) and transforming data into desired formats for downstream consumption.
Routing and Enrichment:
o Configuring NiFi to route data to appropriate destinations and enriching data with additional information (e.g. timestamps location).
Scalability and Performance:
o Ensuring data flows are scalable and performant to handle varying data volumes and velocity.
NiFi Cluster Management:
o Maintaining and improving NiFi clusters including configuration optimization and troubleshooting.
Microservices Integration:
o Developing and integrating microservices to support data conditioning format validation and transformation processes.
Airflow Expertise:
o Possessing deep knowledge of Airflows architecture including schedulers executors (Celery Kubernetes) and plugin development.
Workflow Design and Development:
o Designing and developing complex modular and reusable DAGs (Directed Acyclic Graphs) to automate data pipelines.
Performance Optimization:
o Identifying and addressing performance bottlenecks in Airflow environments and implementing best practices for orchestration and scheduling.
Integration with Cloud Services:
o Integrating Airflow with cloud-native services like Azure Data Factory Azure Databricks Azure Storage and others.
CI/CD Pipeline Management:
o Developing and maintaining CI/CD pipelines for Airflow DAG deployment testing and version control often using tools like Azure DevOps.
Troubleshooting and Issue Resolution:
o Identifying and resolving issues related to data flows NiFi configurations and data integration processes
Technical Skills:
Strong NiFi Expertise: Deep understanding of NiFi architecture processors controllers and data flow management capabilities.
Data Integration and ETL: Experience with data integration ETL processes and data modeling concepts.
Programming Languages: Proficiency in Java Python or other relevant scripting languages.
Database and SQL: Familiarity with databases SQL and data manipulation techniques.
Big Data Technologies: Knowledge of big data technologies like Kafka.
o Creating and implementing data flow solutions using NiFi including defining data sources destinations and transformation processes.
Ingestion and Transformation:
o Managing data ingestion from various sources (e.g. files databases APIs) and transforming data into desired formats for downstream consumption.
Routing and Enrichment:
o Configuring NiFi to route data to appropriate destinations and enriching data with additional information (e.g. timestamps location).
Scalability and Performance:
o Ensuring data flows are scalable and performant to handle varying data volumes and velocity.
NiFi Cluster Management:
o Maintaining and improving NiFi clusters including configuration optimization and troubleshooting.
Microservices Integration:
o Developing and integrating microservices to support data conditioning format validation and transformation processes.
Airflow Expertise:
o Possessing deep knowledge of Airflows architecture including schedulers executors (Celery Kubernetes) and plugin development.
Workflow Design and Development:
o Designing and developing complex modular and reusable DAGs (Directed Acyclic Graphs) to automate data pipelines.
Performance Optimization:
o Identifying and addressing performance bottlenecks in Airflow environments and implementing best practices for orchestration and scheduling.
Integration with Cloud Services:
o Integrating Airflow with cloud-native services like Azure Data Factory Azure Databricks Azure Storage and others.
CI/CD Pipeline Management:
o Developing and maintaining CI/CD pipelines for Airflow DAG deployment testing and version control often using tools like Azure DevOps.
Troubleshooting and Issue Resolution:
o Identifying and resolving issues related to data flows NiFi configurations and data integration processes
Technical Skills:
Strong NiFi Expertise: Deep understanding of NiFi architecture processors controllers and data flow management capabilities.
Data Integration and ETL: Experience with data integration ETL processes and data modeling concepts.
Programming Languages: Proficiency in Java Python or other relevant scripting languages.
Database and SQL: Familiarity with databases SQL and data manipulation techniques.
Big Data Technologies: Knowledge of big data technologies like Kafka.
Key Skills
- Corporate Accounting
- Facilities Management
- Account Development
- Accountancy
- Jdbc
- ITI
