Platform Engineer – OBSv2 to AWS S3 Migration Platform
- Location
- Dallas, Texas, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
### Role & Company / Project Overview We are looking for an experienced Platform Engineer to design, build, and manage a scalable AWS-based platform for migrating large volumes of object data from OBSv2 or other S3-compatible storage platforms to Amazon S3. This is a contract position with a preference for local candidates. ### Key Responsibilities & Daily Duties • Lead end-to-end migration workflows from OBSv2 source buckets to AWS S3 destination buckets. • Build automated migration orchestration using AWS serverless services and container-based workloads. • Implement manifest-based and dynamic migration strategies, including batching, sharding, retries, and task management. • Design bandwidth allocation, queue management, prioritization, and throttling mechanisms. • Develop monitoring dashboards, alerts, health checks, and migration progress reports. • Ensure secure multi-account deployments, performance optimization, testing, and production cutover. • Prepare technical documentation, operational runbooks, and support procedures. ### Required Qualifications, Skills & Experience • Mandatory Technical Skills: - AWS: Lambda, Step Functions, SQS, SNS, EventBridge, API Gateway, AWS Batch, ECS Fargate. - Amazon S3: Object storage, S3-compatible APIs, Intelligent-Tiering, metadata, and lifecycle management. - Object Storage Migration: Hands-on experience migrating large datasets from OBSv2, Dell ECS, or similar platforms to AWS S3. - rclone: High-volume data transfers, checksum validation, retries, logging, concurrency, and bandwidth throttling. - Python: Strong development skills with boto3, APIs, JSON processing, exception handling, and logging. - DynamoDB: Table design, indexes, batch operations, and migration job/task state management. - Networking: VPCs, private subnets, Direct Connect, Transit Gateway, S3 Gateway Endpoints, and high-throughput networking. - IAM & Security: Cross-account access, STS AssumeRole, Secrets Manager, and least-privilege access. - Monitoring: CloudWatch dashboards, logs, metrics, alarms, and migration progress reporting. - CI/CD: GitLab repositories, pipelines, deployment automation, and environment-specific configurations. • Preferred Experience: - Experience with Dell ECS, OBSv2, or enterprise S3-compatible object storage. - Experience with large-scale enterprise data migrations in production environments. - Knowledge of multi-account AWS hub-and-spoke architectures. - Strong documentation and stakeholder communication skills. • Visa: Any genuine visa accepted. ### Working Hours, Shifts & Location Details • Job Type: Contract. • Location: Dallas, TX (Local candidates preferred). • Interview: Face-to-Face (F2F) mandatory. ### Compensation & Benefits • Not specified. ### Application Instructions • Interested candidates should share their updated resume along with their visa type and current location.