Software Developer ( R-00058336 )
Leidos is looking for a Software Developer to join a small data services team responsible for ingesting, monitoring, and maintaining a common data layer and creating efficient data structures to support data science activities. This position is located in the Reston, VA area and requires an active TS/SCI with Polygraph in order to be considered.
The Developer will work closely with members of the data services team, as well as with a dev-ops team, which together are responsible for delivering and maintaining a dynamic data science prototyping environment that provides users with compute resources and shared services, tools, and data.
Developer support for the data services team will include:
Create data ingestion workflows to populate a common data layer with a standard formatted data product.
Create and maintain a common data ingestion framework that is used to streamline the addition of new data sets to the common data layer.
Monitor and maintain data ingestion workflows to ensure that data continues to flow into the system on a reliable basis.
Create efficient data structures that can be used to streamline access to common mission and analytical functions.
Provide technical support to data scientists and other users of the environment; apply knowledge gained from interaction with users to improve and advance the analytic environment by engaging with the environment dev-ops team to ensure evolving needs/capabilities are being captured and developed.
Requires BS degree and 12 – 15 years of prior relevant experience or Masters with 10 – 13 years of prior relevant experience. May possess a Doctorate in technical domain.
Linux and bash scripting.
Apache Hadoop and/orApache Spark stack for big data processing.
AWS and Amazon services such as S3 and EC2.
SQL and relational database technologies, for example, PostgreSQL, MySQL, RDS, etc.
Code repositories and build/deployment pipelines, specifically using Jenkins and Git.
Developing ETL pipelines.