Job description

Client: Options Clearing Corporation Location: Hybrid downtown Chicago Interview Mode: Virtual 2 rounds • Contingent Worker - RCR-956 TDM-6 • I. WORK TO BE PERFORMED: • Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations. • Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data sources, transforming as per provided business rules or data mappings, and loading into target databases/services including DB2, AWS S3, and Apache Iceberg. • Serve as a subject matter expert on multiple data integration projects, ensuring consistent design and efficient data processing. • Play a leading role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations. • Provide Level 2 and Level 3 technical support to mission-critical applications. • Perform process improvement and re-engineering with an understanding of technical data problems and solutions as they relate to the current and future business environment. • Analyze complex distributed production deployments and make recommendations to optimize performance. • Design and develop innovative data solutions for demanding business situations. • Develop and document Data Integration standards and procedures. • Design reusable and portable Data Integration components. • Transform flat delimited files into multiple formats, including Parquet, JSON, and Protobuf. • Play a supporting role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations. • Investigate production Data Integration issues and work to determine the root cause of problems. • Work with the DBA teams to fix performance issues as required. • Work with the QA team to address testing issues as they occur. • Work with the Data Quality/Data Governance team to ensure required data quality and data integrity standards are met. • Design reusable Data Integration components. • Participate in daily Scrum standups. Update task status in Jira. • Conduct Code reviews and incorporate suggested improvements/fixes. • Perform other duties as assigned. • * II. SKILL AND EXPERIENCE REQUIRED: • 3+ years in IT application development, with at least 2 years in Data Integration (ETL) Development, using tools such as DataStage, Python, SQL and Unix Shell Scripting. • Experienced practitioner with a proven track record of implementing mid-scale to large-scale Data Integration (ETL) solutions, performing data analysis and profiling, interacting with client management, and designing and architecting dynamic ETL solutions. • Working knowledge for Data Types and Databases including Relational, Dimensional, Vertical and No SQL databases. • Hands-on experience with data cleansing and data visualization and familiarity with Hadoop Ecosystem. • Experience with platforms such as Hive and Trino/Starburst. • Strong conceptual knowledge of file formats such as JSON, Parquet and Protobuf. • Capable of writing and optimizing SQL queries and stored procedures. • Exposure to AWS Services including but not limited S3, PostgreSQL, Apache Iceberg and Kafka. • Ideal candidate would have worked on a Scrum Team and familiar with using tools such as Jira and Git. • Experience developing containerized Data Integration solutions using Kubernetes, Rancher, and CI/CD pipelines using Harness, Jenkins and Artifactory is a plus. • Experience working with scheduling tools such as UC4, Control-M, or Autosys is a plus. • Experience working with Cloud ecosystems (AWS, Azure, GCP, AWS preferred) in multi-availability zone, multi-region deployments. • Experience in database performance optimization techniques, multidimensional database designs, and physical database implementations for databases including DB2 and Apache Iceberg is a plus. • Strong verbal/written communication skills. • Ability to interact with business users and to develop positive working relationships. • AWS Certified Solution Architect Associate Level is a plus. • Big data related certification is a plus.

Requirements