Allstate Arity - Hadoop Systems Engineer in Chicago, Illinois

Arity - Hadoop Systems Engineer

Apply Now at https://www.applytracking.com/tp/rj6.8s5op.e_K

Job ID :

112107

Location :

Chicago, IL US

Level :

Manager

Job Category :

Information Technology

Description :

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.

At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.

That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.

Job Description

Data Science incorporates techniques across many disciplines – including mathematics/statistics, computer programming, data engineering and ETL, software development, and high performance computing – with traditional business expertise with the goal of extracting meaning from data to optimize future business decisions. Individuals in this field should be an expert/fluent in several of these disciplines and sufficiently proficient in others to effectively design, build, and deliver end to end predictive analytics products to optimize future decisions. Individual demonstrates sufficient analytic agility to quickly develop new skills across these disciplines as those disciplines evolve. The Big Data Engineer job family is accountable for end to end engineering of data solutions which includes designing and building systems for data storage and analytics that enable Allstate analysts to make better decisions to achieve Allstate’s goals.

This role is responsible for leading efforts of medium to high complexity and critical tracks of delivery of Big Data platforms to make decisions. This includes the development and recommendation of new Big Data systems for analyzing data; the coding & development of advanced analytics solutions to make/optimize business decisions and processes; searching for and integrating new tools to improve descriptive, predictive, and prescriptive analytics; and discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions. This role will also begin project management of complex projects.

This role contributes to the structured and unstructured Big Data / Data Science tools of Allstate from traditional to emerging analytics technologies and methods. The role is responsible for assisting in the recruitment, selection, mentorship and development of other team members.

Job Responsibilities

  • Make major contributions to the Big Data direction and strategy for the group in partnership with their peers.

  • Executes highly complex functional work tracks for the team. Drives the execution of operational/technical objectives for data analytic outputs and business solutions.

  • Is an active technical leader within the department

  • Partners with ATSV teams on Big Data efforts.

  • Partners closely with peers in the department to ensure holistic Big Data solutions for our data science community and analytic users.

  • Identifies new areas of data, research and Big Data technology that can solve business problems

  • Utilize effective project planning techniques to break down complex projects into tasks, manage scope of projects, and ensure deadlines are kept

  • Leverages, contributes and uses Big Data best practices / lessons learned to develop technical solutions used for descriptive analytics, ETL, predictive modeling, and prescriptive “real time decisions” analytics

  • Influences within the department on the effectiveness of Big Data systems to solve their business problems.

  • Is recognized as an expert in Big Data and is influential within the department.

  • Develops technical solutions using Big Data techniques in data & analytics processes.

  • Supports Innovation; regularly provides new ideas to help people, process, and technology that interact with analytic ecosystem.

  • Develops and builds frameworks/prototypes that integrate Big Data and advanced analytics to make business decisions.

  • Implements new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems.

  • Understands the Big Data related problems and requirements to identify the optimal technical approach.

  • Works with QR&A peers to ensure efforts within owned tracks of work will meet their needs.

  • Drives multiple tracks of complex work within the research group.

  • Identifies and develops Big Data sources & techniques to solve business problems.

  • Co-mingles data sources to lead work on data and problems across departments to drive improved business & technical results through designing, building, and partnering to implement models.

  • Manages various Big Data analytic tool development projects with midsize to large teams.

  • Executes on Big Data requests to improve the accuracy, quality, completeness, speed of data, and decisions made from Big Data analysis.

  • Uses, learns, teaches, and supports a wide variety of Big Data and Data Science tools to achieve results (i.e., R, ETL Tools, Hadoop, and others).

  • Uses, learns, teaches, and supports a wide variety of programming languages on Big Data and Data Science work (i.e. Java, C#, Python, and Perl).

  • Ensures the development and execution of a communication strategy that keeps all relevant stakeholders informed and provides an opportunity to influence the direction of the work

  • Trains, develops, and teaches more junior engineers.

Job Qualifications

  • 3 - 5 Years of experience or equivalent skills & ability

  • Master’s or PhD preferred in a quantitative or scientific field such as computer science, computer engineering or equivocal experience.

  • Experience in using software development to drive data science & analytic efforts.

  • Experience with database & ETL technologies.

  • Experience with various data types (e.g. Relational, Unstructured, Hierarchical, and Linked “Graph” Data).

  • Experience in developing, managing, and manipulating large, complex datasets.

  • Experience in working with statistical software such as SAS, SPSS, MatLab, R, CART, etc.

  • Proven ability to code and develop prototypes in languages such as Python, Perl, Java, C, R, SQL, and XSLT.

  • Ability to communicate and present advanced technical topics to general audiences.

  • Leading project teams of various skills levels.

  • Understanding of predictive modeling techniques a plus.

That’s the day-to-day, now let’s talk about the rest of it. As we mentioned, Arity was founded by The Allstate Corporation. But you’ll be working for—and at—Arity. It’s the best of both worlds. You’ll get access to the full suite of Allstate benefits and work in a fast-paced startup culture. That’s more than just free breakfasts, brain breaks and ping pong. It’s a culture that encourages you to be you.

Sound like a fit? Apply now! We can’t wait to meet you.

Arity.com at https://www.arity.com/ Instagram at https://www.instagram.com/arityofficial/ Twitter at https://twitter.com/arity LinkedIn at https://www.linkedin.com/company/arity/

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click "here" at http://sfgov.org/olse/sites/default/files/FileCenter/Documents/11600-Art%20%2049%20Official%20Notice%20Final%20091114.pdf for information regarding the San Francisco Fair Chance Ordinance.

For jobs in Los Angeles, please click "here" at http://bca.lacity.org/fair-chance for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

It is the policy of Allstate to employ the best qualified individuals available for all jobs without regard to race, color, religion, sex, age, national origin, sexual orientation, gender identity/gender expression, disability, and citizenship status as a veteran with a disability or veteran of the Vietnam Era.