Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
- Be part of a growing technology team in the middle of a digital transformation
- Join a fun place where people look forward to coming to work every day but also offer the flexibility to determine your own workfromhome schedule too!
Our Company
We are now the global leader in industry market research with a very loyal following of the worlds elite businesses we want to build relationships with at scale. How did we come to be a global leader Its all about our peopleand we are looking to add even more talented people to our growing technology team.
IBISWorld is a place where we love coming to work every day but also offers flexible working arrangements because we know worklife balance is important to make you successful. Do you want an environment where decisions are made together Are you looking to play an integral role in the data and technology functions of a company
At IBISWorld our people are our most important asset. Our offices are filled with professionals who work hard for our clients and also love to have fun. We promote a supportive and collaborative environment where management is invested in your development and growth. Be part of a technology and data team that can influence the way we think about and develop our products.
Job Overview
The Data Engineer will work within IBISWorlds IT Research and Product Development teams responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and innovating to further build them out. The Data Engineer will support our software developers database architects data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be selfdirected and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even redesigning our companys data architecture to support our next generation of products and data initiatives.
IBISWorlds data team sits at the heart of product development within IBISWorlds product and IT teams responsible for providing our 100000 customers with data and insights on over 10000 industries globally.
This dataheavy role will also require working effectively with the broader IT development team across a range of projects and technologies so strong communication and collaborative skills are must.
Key Duties
- Assemble large complex data sets that meet functional / nonfunctional business requirements.
- Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using Snowflake and AWS big data technologies.
- Identify design and implement internal process improvements: automating manual processes optimizing data delivery redesigning infrastructure for greater scalability etc.
- Work with stakeholders including the Product Data and IT teams to assist with datarelated technical issues and support their data infrastructure needs.
- Create data tools for analysts and other Data Team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
As a successful candidate you will have:
- BA/BS degree in in Computer Science Statistics Informatics Information Systems or another quantitative field. Graduate Degree a plus.
- 35 years of experience in a Data Engineer role with direct experience with data ingestion ETLs eventdriven architecture and using/implementing forecasting or imputation algorithms using large datasets
- Experience with relational SQL and NoSQL databases including SQL Server and Snowflake.
- Experience with InfrastructureAsCode tools preferably Terraform
- Experience with AWS cloud services: Lambda Step Functions Glue CloudTrail CloudWatch SNS SQS S3 etc.
- Experience with objectoriented/object function scripting languages: Python C etc. Python preferred.
- Experience with data warehousing using ELT integration processes
- Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing big data data pipelines architectures and data sets.
- Build processes supporting data transformation data structures metadata dependency and workload management.
- A successful history of manipulating processing and extracting value from large disconnected datasets.
Other skills:
- Exceptional analytical and problemsolving skills; commercial mindset
- Exceptional organizational skills with the ability to manage and prioritize various responsibilities and consistently meet deadlines. Flexibility to effectively deal with unexpected assignments changes to workload or design revisions midproject based on management priorities or client requests
- Excellent interpersonal written and verbal communication skills especially with stakeholders who often have limited technical knowledge
- Ability to work with others as well as independently and autonomously with minimal supervision
Benefits
- Flexible working hours and remote working arrangements
- Professional development and training
- Employee benefits and rewards via free breakfast fruit and the Perkbox app
- Subsidized gym membership at the Grand Hyatt City Club
You will be rewarded with a competitive salary super work from home days as well as a great working environment.
If you think you are the ideal candidate for this role please apply by submitting your resume and a short cover letter. If you would like to know more about IBISWorld please visit our Careers Page ( is an Equal Opportunity Employer. All applicants must be authorised for employment in Australia.
Employment Type
Full-Time
