Comcast Principal Data Integration Architect in West Chester, Pennsylvania
Comcast's Technology & Product organization works at the intersection of media and technology. Our innovative teams are continually developing and delivering products that transform the customer experience. From creating apps like TVGo to new features such as the Talking Guide on the X1 platform, we work every day to make a positive impact through innovation in the pursuit of building amazing products that are enjoyable, easy to use and accessible across all platforms. The team also develops and supports our evolving network architecture, including next-generation consumer systems and technologies, infrastructure and engineering, network integration and management tools, and technical standards.
This is a senior position within the Systems Engineering Data Service organization reporting to the Senior Manager. The DS group has responsibility for Data Service for Comcast, one of the major goal is to harmonize the data ingestion and consumption layer across Comcast.
Creating the enterprise data sources, Data Lake, EDW, ODS, transaction data source as a single version of truth for data analysis for Comcast business. The Principal Architect must be able to design, drive and deliver the architecture using best and efficient BigData technologies like
Hadoop-Hive, Impala, Pig, Flume, Sqoop, Storm, Spark, Kafka, Accumulo, and HBase
Data Warehosuing Technologies likeTeradata and Informatica ETL
The Principal Architect is responsible for working across multiple solution architects, business partners and programs and projects to harmonize, data platform, process, integration, data asset within Comcast.
Collaborate and partner with technical and business team to present, define, strategies, requirement, road-map, budget, solution. Prepare and present Gap analysis, for technology and business solution up-to VP level.
-Manage and support all project related architect, design, development, deployment of data-oriented integration across platform and projects as matrix organization. The Data Integration and solution architect must have strong working experience with following Big Data Tools & Technologies: Hadoop Hive, Pig, Flume, Sqoop, Spark, Storm, Kafka, Accumulo, HBase, SQL, Linux, Shell Scripting, Data Warehousing and Teradata
-Informatica, SQL, BTEQ, , Java and UC4 are Nice To Have
-Provides direction for diverse and complex initiatives and is accountable for a variety of tasks to architect and deliver data warehousing solutions that exceed customer expectations in content, usability, accuracy, reliability and performance while assuming a leading role within agile teams (both on-shore and off-shore)
-Design processes and components of a streaming data/ETL pipeline to support real-time analytics from requirements to data transformation, data modeling, metric definition, data quality and data reconciliation.
-Lead Data Source discovery and Integration services by evaluating business value, exploring new data sources and collaborating with product owners and business partners
-Interprets business strategy and develops organizational objectives to align with this strategy. Typically manages multiple teams of professionals.
-Development of End to End ETL data integration and solution architecture
-Worked across technical and business team in order to harmonization data asset
-Experience with SQL & BTEQ Scripting: Strong data management and data analysis and performance tuning required.
-Candidate might have worked as one or more role e.g. Data architect, Data modeler, Data integration developer/architect, ETL developer/architect.
-Experiences solution architect to design, develop and implement ODS, EDW, Data Integration Layer etc.
-Knowledge in data warehousing methodologies and best practices required.
-Strong verbal and written communication skills required.
-Effective interpersonal relations skills, ability to effectively collaborate with others and work as part of a team required.
-Skills in navigating a large organization in order to accomplish results required.
-Ability to initiate and follow through on complex projects of both short and long term duration required.
-Excellent organizational and time management skills required.
-Excellent analytical and problem solving skills required.
-Works independently, assumes responsibility for job development and training, researches and resolves questions and problems, requests supervisor input and keeps supervisor informed required.
-Participate on interdepartmental teams to support organizational goals
-Perform other related duties and tasks as assigned
-Punctual, regular, and consistent attendance
-Advanced Degree in technical discipline and/or management required. 10 year of experience with data integration, Big Data Technologies, Data Warehouse and ETL Architecture.
-Five to seven years' experience leading data integration with Hadoop, Kafka, Hive, Pig, Flume, Sqoop, and UC4, ETL architecture using Linux, Teradata, SQL, BTEQ,. This experience is a must have.
-Experience in desiging and architecting efficient Big Data Solution with large data processing jobs (batch or real-time) to load, process and analyse using Hadoop ecosystem.
-Experience in designing databases, and Hadoop solutions around high volume enterprise applications using any of NOSQL solutions like HBASE,Cassandra and Accumulo.
-Exposure to desinging and Implementing solutions and tools to help maintain data integrity/reconciliation on Hadoop and traditional RDBMS ecosystem.
-Extensive experience with Hadoop and Teradata Ecosystems.
-Experience working across multiple solution architect, business partner and program and project to harmonize, data platform, process, integration, data asset within Comcast.
-5 year of experience working as Big Data Architect, data integration, Data Lake, EDW, ODS, ETL architect or similar role required.
-Experience working as solution architect supporting Platform as Service Organization.
-Requires understanding of complete SDLC and Experience with continuous integration, test-driven/behavior-driven development, and agile, scrum development methodologies
-Experience collaborating and partner with technical and business team to present, define, strategies, requirement, road-map, budget, solution.
-Experience presenting strategies, road-map and gap analysis, for technology and business solution up-to VP level
-Experience designing logical and physical architectures
-Experience managing teams of senior technologists
-Experience working in an Agile development methodology in a data warehouse environment
-Ability to work effectively across organizational boundaries
-Excellent oral, written, analytical, problem solving, and presentation skills
-Manage and Co-ordinate 1-10 matrix resources,
-Experience with mange service and on-shore and off-shore development experience is must
Desired Skills/ Experience
-Telecommunications experience Knowledge of Telecommunication/Cable billing, customer care systems e.g. DST, CSG and AMDOC etc.
Comcast is an EOE/Veterans/Disabled/LGBT employer