US E-Consulting AMM Data Engineer - Specialist Senior - CBO-AMI (48286)
- Minimum of 5+ years of experience in a Data Engineer role and must have experience using the following software/tools:
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with Legacy to Cloud platform migration
- Experience with building the ETL migration Strategies
- Experience with relational SQL and NoSQL databases, including Aurora, Azure, Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with the cloud services and data warehouse: EC2, EMR, RDS, Redshift and Data Lakes.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Demonstrated expertise in building and optimizing 'big data' data pipelines, architectures and data sets
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- A successful history of manipulating, processing and extracting value from large disconnected datasets
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
- Strong analytic skills related to working with unstructured datasets
- Experience supporting and working with cross-functional teams in a dynamic environment
- Additional experience in commercial database platforms
- Strong oral and written communication skills, including presentation skills (MS Visio, MS PowerPoint)
- Strong problem solving and troubleshooting skills with the ability to exercise mature judgment
• Limited Sponsorship : Limited immigration sponsorship may be available