C2 SMART Integration Engineer (Data Tagging and Availability)
Tasks
- Architect and manage Apache Kafka clusters
- Automate workflows using workflow orchestration tools
- Build data lineage with tagging events and approvals
- Build metadata extraction and synchronization pipelines
- Define data contracts across domains
- Design and implement automated data tagging frameworks
- Design canonical data models for cross domain exchange
- Design secure cross domain integration patterns
- Document tagging schemas and integration patterns
- Ensure compliance using automated tagging and retention policies
- Implement SLA monitoring and alerting
- Implement data quality workflows
- Implement governed data workflows with approval gates
- Implement streaming workflows triggered by Kafka messages
- Implement tag based access control
- Integrate with data catalogs to manage metadata
- Integrate workflow engines with data catalogs and tagging systems
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudFormation | AWS ECS | AWS Glue | AWS IAM | AWS Lambda | AWS MSK | AWS Step Functions | Access Control | Alation | Amazon S3 | Amundsen | Apache Airflow | Apache Kafka | Apache Kafka Connect | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | Azure Logic | Azure Logic Apps | Azure Purview | Azure Resource | Azure Resource Manager | Azure Synapse | CI/CD | Cluster administration | Collibra | DCAT | Dagster | Data Catalogs | Data Classification | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data fabric | Data mesh | Datahub | Docker | Event Driven | Event Hubs | Event-driven architecture | Git | GitHub Actions | GitLab CI | Helm | Jenkins | KSQLDB | Kafka Cluster | Kafka Connect | Kafka Schemas | Kafka Streams | Kafka cluster administration | Kubernetes | Logic Apps | Metadata Management | Metadata synchronization | OpenLineage | PCI | PII | Phi | Prefect | Resource manager | Step Functions | TBAC | Tag Based Access Control | Terraform | W3C PROV
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Software Developer - Embedded USD 80K-135K.NET | C# | Continuous integration | Embedded Software | Ethernet401k match | Dental insurance | Disability insurance | Health savings accounts | Life insuranceMid-level Full TimeLas Vegas, NV, United States14h ago
-
Computer Scientist II USD 110K-140KAgile | Angular | Azure DevOps | C# | CI/CD401k employer match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceMid-level Full TimeLas Vegas, NV, United States14h ago
-
Management Systems Computer Scientist I USD 123K-140KAmazon Aurora | Amazon DynamoDB | Amazon RDS | Amazon Web Services | Azure SQL401k plan | Dental insurance | Disability insurance | Health insurance | Health savings accountMid-level Full TimeEdwards AFB, CA, United States14h ago
-
AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatch | Amazon EC2100 percent onsite | Onsite in McLean VASenior-level ContractMc Lean, United States17h ago
-
Senior-level ContractAustin, United States18h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States18h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States18h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Advanced Analytics | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Remote work options | TechtalksSenior-level Full TimeJacksonville, United States18h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageFlexible schedule | Mentorship | Personalized growth roadmap | Remote work options | TechtalksSenior-level Full TimeHouston, United States18h ago
-
Data Engineer - TechCare Operations: Blueprint team USD 103K-174KAgile | DBMS | Data Architecture | Data Modeling | Database AdministrationCareer development and training | Company 401k match | Disability benefits | Employee counseling support | Financial coachingSenior-level Full TimeUS-Arizona-Phoenix18h ago
-
Senior AI Engineer USD 123K-215KAPI Design | API Versioning | AWS | Argo Workflows | Authentication & AuthorizationCareer development and training | Confidential counseling support | Employee wellness centers | Financial coaching | Health insuranceSenior-level Full TimeUS-Arizona-Phoenix18h ago
-
Data Engineer USD 117K-195KAWS | Cloud Security | Cloud infrastructure | Data Governance | Data LakesHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R18h ago
-
Accelerator Virtualization | Artificial Intelligence | Container Orchestration | Container Runtime | Distributed SystemsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA20h ago
-
Forward Deployed Engineer III, Applied AI, Google Cloud USD 183K-265KAPIs | Agent systems | Chain-of-Thought | Conversational AI | CrewAICollaboration with research and engineering experts | Direct access to DeepMind teams | High travelSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …20h ago
-
Senior-level Full TimeBoston, MA1d ago
-
Senior-level Full TimeBelmont, CA, US, 940021d ago
-
AI Agents | AI Search | AWS | AWS Bedrock | Agentic Workflows401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States1d ago
-
Senior Data & ML Engineer USD 151K-205KDBT | Data Governance | Data Observability | Data Quality | Data Security401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R1d ago
-
Staff Machine Learning Engineer USD 141K-210KCI/CD | Computer Vision | Deep learning | Distributed Training | DockerSenior-level Full TimeSunnyvale, CA, United States1d ago
-
Senior Software Engineer, Data Platform USD 196K-245KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEquity | Inclusion and reasonable accommodations | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area1d ago
-
Senior AI Technologist USD 122K-180KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior AI Systems Engineer USD 122K-188KAlerting | Bash | CI/CD | CMMC | Cause analysisFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior Data Engineer USD 150K-220KClustering | Common table expressions | DBT | Dagster | Data LineageIn-office work 4 days per week | On-call rotationSenior-level Full TimeNew York, NY1d ago
-
Senior-level Full TimeNew York, NY1d ago
-
Data Engineer (Hybrid) USD 120K-140KAzure | DAX | Data Governance | Data Modeling | Data QualityHybrid workSenior-level Full TimeSanta Ana, CA, US1d ago