Oracle Senior Hadoop Administrator in Chicago, Illinois

Analyze, design develop, troubleshoot and debug software programs for commercial or end user applications. Writes code, completes programming and performs testing and debugging of applications.

As a member of the software engineering division, you will analyze and integrate external customer specifications. Specify, design and implement modest changes to existing software architecture. Build new products and development tools. Build and execute unit tests and unit test plans. Review integration and regression test plans created by QA. Communicate with QA and porting engineering to discuss major changes to functionality.

Work is non-routine and very complex, involving the application of advanced technical/business skills in area of specialization. Leading contributor individually and as a team member, providing direction and mentoring to others. BS or MS degree or equivalent experience relevant to functional area. 7 years of software engineering or related experience.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans status or any other characteristic protected by law.

About Oracle Utilities

At Oracle Utilities (Opower), we re applying cutting-edge computer science to one of humanity s greatest challenges: Energy. Our utility customers in the U.S. and abroad give us energy usage data for tens of millions of their customers, which we then analyze and aggregate using state-of-the-art tools such as Hadoop and Spark. If you are a top-notch system administrator looking for a fast-paced place to work while being surrounded by talented, driven peers then Oracle Utilities is the place for you.

About the Job

The Data Platform team at Opower is a cross-functional team of application developers, big data engineers, data scientists, and administrators who load and analyze the billions of utility data reads we receive each month. Our Hadoop administrators work closely with other engineers in an agile development environment to build the infrastructure that supports everything from ETL and ingest pipelines to data science research and batch machine learning processes.


  • Take the lead in ongoing administration and capacity planning for large parts of our Hadoop infrastructure.

  • Work within the team to optimize cluster usage and ensure timely execution of business-critical workloads as we expand our use cases to support new products.

  • Configure and monitor of job isolation, security, and resource queues.

  • Install Hadoop updates, patches, and version upgrades as required.

  • Perform routine cluster maintenance, such as provisioning new nodes and performing HDFS backups and restores.

  • Develop scripts and tools to automate common Hadoop administration tasks.

  • Participate in an on-call rotation with 24x7 availability requirements.

About You

  • 5 or more years in a typical system administration role, performing system monitoring, storage capacity management, performance tuning, and system infrastructure development.

  • 2 or more years of experience in deploying and administering a large Hadoop cluster. Ability to isolate and troubleshoot Hadoop service issues using a combination of system and Hadoop logs and monitoring/alerting systems. Experience with Cloudera Manager preferred.

  • Experience administering a data warehouse and analytics infrastructure using YARN, Spark, Hive, and/or Impala. Management of Hive UDF s and PySpark dependencies preferred.

  • Experience with a scripting language such as Ruby or Python.

  • Experience with a configuration management tool such as Puppet or Chef.

  • Detailed knowledge of basic OS administration tasks such as configuring PAM authentication, disk quota, ulimit, etc. and managing security patches.

  • Experience configuring and using monitoring tools such as OpenTSDB, Splunk, and Grafana to diagnose cluster issues and propose operational enhancements.

  • Experience managing search infrastructure such as Elasticsearch is a plus.

Job: *Product Development

Organization: *Oracle

Title: Senior Hadoop Administrator

Location: United States

Requisition ID: 180006HZ