SchaumburgRecruiter Since 2001
the smart solution for Schaumburg jobs

Senior Data Engineer

Company: CAT Technology, Inc
Location: Schaumburg
Posted on: November 23, 2020

Job Description:

Senior Data Engineer Location Schaumburg, IL 6 Months - Contract to Hire Manager has been rejecting resumes for a couple reasons. Either they do not include the required write up which should list how many years of each skill listed. Or the Write up does not match the resume. Example Write up says 5 years of DataBricks experience, but resume only shows 1 year. Description This person needs to figure out how to use Databricks Apache Spark, to organize their big data sets for this initiative. Needing strong exp with Bid Data, working with large Data sets and tables, and need to be able to speak in-depth about this stuffhellip not just surface level. Projects the candidate will be working on bullCreate and maintain data pipelines between on-premise data center, Azure Data Lake Storage, and Azure Synapse database using Databricks and Apache SparkScala. bullThis role is for a senior data engineer that will join a team responsible for managing a growing cloud-based data ecosystem consisting of a metadata driven data lake and databases that support real time analytics, extracts, and reporting. bullThe right candidate will have a solid background in data engineering and should have a few years of experience on a major cloud platform such as Azure Top Responsibilities bullBuilding and maintaining a data processing framework on Azure using Databricks bullWriting code in Apache SparkScala bullWorking with existing Databricks Delta Lake tables to optimize for CDC performance using techniques bullWorking with existing Databricks Notebooks to optimize or address performance concerns bullCreate new Databricks Notebooks or stand-alone Apache SparkScala code as needed bullWillingness to learn existing on-premise data management tools as required, such as Ab Initio Software toolsskills bullDatabricks bullApache Spark bullScala programming bullAzure. Skillsattributes bullData engineering experience - 5 years bullCloud platform experience ndash 2 years bullVersion Control (Git or equivalent) - 2 years. Nice to have bullData Integration Tools (SparkDatabricks or equivalent) 2 years bullVersion Control (Git or equivalent) 2 years bullScripting (LinuxUnix Shell scripting or equivalent) 2 years bullNetezza experience. Normal 0 false false false EN-US X-NONE X-NONE MicrosoftInternetExplorer4 Style Definitions table.MsoNormalTable mso-style-name"Table Normal" mso-tstyle-rowband-size0 mso-tstyle-colband-size0 mso-style-noshowyes mso-style-priority99 mso-style-qformatyes mso-style-parent"" mso-padding-alt0in 5.4pt 0in 5.4pt mso-para-margin0in mso-para-margin-bottom.0001pt mso-paginationwidow-orphan font-size10.0pt font-family"Times New Roman","serif"

Keywords: CAT Technology, Inc, Schaumburg , Senior Data Engineer, Engineering , Schaumburg, Illinois

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Client Integration Engineer
Description: Company DescriptionEpsilon is the leader in outcome-based marketing. We enable marketing that's built on proof, not promises. Through Epsilon PeopleCloud, the marketing platform for personalizing consumer (more...)
Company: Epsilon
Location: Chicago
Posted on: 11/26/2020

Maintenance Technician (2nd Shift)
Description: Job Description Under general supervision, install, maintain, and repair a variety of machinery and related equipment. Duties Responsibilities Analyze machine problems by using troubleshooting techniques, (more...)
Company: John Crane
Location: Crystal Lake
Posted on: 11/26/2020

Lead Quality Engineer
Description: Grainger is North America's leading Maintenance Repair Operating provider and we are the 10th largest North American E-commerce player with over 50 of our revenue coming from online transactions. We (more...)
Company: Grainger
Location: Chicago
Posted on: 11/26/2020

Lead Backup/Data Protection Engineer
Description: Hiring Manager: Joyeeta Mitra Recruiter: Subha Mohan Grade Level: GRADE 42 Summary: The Global Hosting Compute Storage Service Design team at CDK Global is responsible for designing relevant, frictionless (more...)
Company: CDK Global
Location: Hoffman Estates
Posted on: 11/26/2020

Mac Tools Seeking Mechanics - Technicians - Training Provided
Description: Build a Great Career and a Quality Life with Mac Tools. br br Feel the freedom and independence of working on your own, in a stress free environment - with no one to answer to, except yourself Join (more...)
Company: Mac Tools
Location: Griffith
Posted on: 11/26/2020

Regional Sales Engineer
Description: The Regional Field Engineer is responsible for assisting Regional Sales Teams and Partners with the technical sales activities in new and existing opportunities. br br The Regional Field Engineer (more...)
Company: Varonis
Location: Chicago
Posted on: 11/26/2020

Regional Facilities/Engineering Manager
Description: Unit DescriptionWe are the Communities we serve --This account is part of the SodexoMAGIC portfolio of business.--Use your passion for service to create a positive impact and make a difference in the (more...)
Company: Sodexo
Location: Chicago
Posted on: 11/26/2020

Sr Carpet Technician SHBF - Training
Description: Job Description br JOB SUMMARY: br The Sr Carpet Technician SHBF Training is responsible for providing quality carpet and upholstery cleaning and other related services to customers. This position (more...)
Company: Sears Home Services
Location: Buffalo Grove
Posted on: 11/26/2020

Automotive Quick Lube Technician
Description: For over five decades, the Russ Darrow Group's purpose has been delivering an uncompromised customer experience. Our passion for our products, loyalty to our customers and dedication to our communities (more...)
Company: Russ Darrow Kia of Waukesha
Location: Waukesha
Posted on: 11/26/2020

Technician Lead / Bonuses / CL
Description: br br Eligible participants who are hired while the program is in effect will receive a 500 sign-on bonus, subject to repayment if the employee voluntarily terminates their employment with XPO Logistics (more...)
Company: XPO Logistics
Location: Aurora
Posted on: 11/26/2020

Log In or Create An Account

Get the latest Illinois jobs by following @recnetIL on Twitter!

Schaumburg RSS job feeds