Chenega Corporation Senior Data Engineer in Dallas, Texas
Company Job Title:
Senior Data Engineer
Director of Data Science & Analytics
Exempt, Full Time, Regular
The Senior Data Engineer will have the unique combination of business acumen needed to interface directly with key client stakeholders to understand the problem along with the skills and vision to translate the need into a world-class technical solution using the latest technologies. The Senior Data Engineer will work side-by-side with key client stakeholders to envision, design and implement complex technical solutions. In addition to direct client work, the Senior Data Engineer will help Precocity develop solutions and capabilities that help differentiate and give us an edge in the market
Duties and Responsibilities:
Work directly with the executive leadership team to help craft our company's go-to-market strategy related to solutions in the analytics and big data space
Work with existing and prospective clients to understand their business context and craft best-in-class solutions to their toughest problems
Architect and implement best-in-class solutions using technologies such as Spark, Cassandra, Kafka, Airflow, Google Cloud DataFlow, BigQuery, Snowflake, Amazon Kinesis / RedShift among others
Create robust and automated pipelines to ingest and process structured and unstructured data from source systems into analytical platforms using batch and streaming mechanisms
Work with data scientists to operationalize and scale machine learning training and scoring components by joining and aggregating data from multiple datasets to produce complex models and low-latency feature stores.
Leverage graph databases and other NoSQL data stores to accomplish tasks that are not possible with traditional databases
Help coach and mentor more junior resources by providing encouraging and constructive feedback and advice
Assist in our recruiting and interviewing process
Develop content and thought leadership that can be published on our blog or web site, or that can be presented at relevant conferences
Assist in the development of proposals and other business development related materials
Contribute to the internal knowledge base to build expertise and awareness within the organization
Other duties as assigned
Minimum Qualifications:(To perform this job successfully, an individual must be able to perform each essential duty satisfactorily.)
Bachelor’s Degree in a technical field
6 years of deep software development and engineering experience
4 years of Python, Java and/or Scala experience.
4 years of RDBMS concepts with strong SQL skills
3 years of experience in the data and analytics space
2 years in key aspects of software engineering such as parallel data processing, data flows, REST APIs, JSON, XML, and microservice architectures.
2 years of experience with modern data processing technologies such as Spark, BigQuery, Snowflake, Hadoop, Hive or AWS Redshift
Experience working in a scrum/agile environment and associated tools (Jira)Some consulting experience preferred
Experience with at least one NoSQL database (e.g., Cassandra, HBase, Couchbase, etc.) and an understanding of the various types of solutions (e.g., graph, document, Key Value, etc.)
Experience with large data sets and associated job performance tuning and troubleshooting
Hands-on experience with DevOps solutions such as Jenkins, Puppet, Chef, Ansible, CloudFormation, etc.
Google Cloud Platform data and analytics tools experience or certification a plus
Kubernetes and Docker experience a plus
Data Modeling experience a plus
Any certifications related to Big Data platforms, NoSQL databases or cloud providers are a plus
Must be authorized to work in the U.S. without requiring sponsorship.
Knowledge, Skills and Abilities:
Must have collegial and collaborative working style
Must be a self-starter and team player, capable of working and communicating with internal and client resources at all levels--including the C-suite.
Ability to deliver independently without oversight from management
Capable of providing technical direction on projects without guidance from clients. We expect you to have opinions!
Ability and desire to work in a consulting environment where understanding new business and technical contexts on a regular basis is the norm.
Strong verbal and written communication skills
A passion for technology with a strong desire to constantly be learning and honing your craft
Equally skilled with the whiteboard and the keyboard
An Understanding of what it takes to make a modern data solution production-ready including operations and monitoring strategies and tools
Detail oriented with the curiosity that compels you to dive deep into the problem, whether to identify the root cause of a quality issue or understand hidden patterns
Understanding and experience with stream processing and analytics tools and technologies such as Kafka, Spark Streaming, Storm, Flink, etc.
Proficient with application build and continuous integration tools (e.g., Maven, Gradle, SBT, Jenkins, Git, etc.)
General knowledge of big data and analytics solutions provided by major public cloud vendors (AWS, Google Cloud Platform, Microsoft Azure).
Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and microservice architecture.
Very strong skills coding relevant solutions or applications using Java and/or Scala.
Strong understanding of Hadoop fundamentals with experience working on Big Data Processing Frameworks and Tools – MapReduce, YARN, Hive, Pig, Oozie, Sqoop, etc.
An understanding of common big data file formats (e.g., Parquet, ORC, etc.).
Strong understanding of RDBMS concepts with strong SQL skills
Working knowledge of data engineering aspects within machine learning pipelines (e.g., train/test splitting, scoring process, etc.)
Physical Demands:(The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.)
- While performing the duties of this Job, the employee is regularly required to sit and talk or hear. The employee is frequently required to walk; use hands to finger, handle, or feel and reach with hands and arms. The employee is occasionally required to stand; climb or balance and stoop, kneel, crouch, or crawl. The employee must occasionally lift and/or move up to 25 pounds. Specific vision abilities required by this job include close vision.
Work Environment:(The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job.)
The employee will normally work in a temperature-controlled office environment, with frequent exposure to electronic office equipment.
During visits to areas of operations, may be exposed to extreme cold or hot weather conditions. Is occasionally exposed to fumes or airborne particles, toxic or caustic chemicals, and loud noise.
Chenega Corporation and family of companies is an EOE.
Equal Opportunity Employer Minorities/Women/Veterans/Disabled/Sexual Orientation/Gender Identity
Native preference under PL 93-638.
We participate in the E-Verify Employment Verification Program.
Organization: Precocity LLC
Title: Senior Data Engineer
Requisition ID: 1900000422