Requirement & Scope :
- Etisalat wants to decommission their old Huawei based Hadoop cluster and redesign and recreate their older spark and MapReduce jobs to modern Spark jobs with 25% Optimizations end to end. This involves 300 plus Spark jobs consists of 200 plus PowerBI and other Reports based on their future cloud-ready platform and jobs designed in such a way that it can be easily migrated to futuristic cloud which is probably AWS.
- Also, customer wants to create 105 Talend jobs to Spark based Data Pipeline.
GC’s Accomplishments:
- Analyzed and recreated all the spark jobs in batches and achieved the committed ETA with good practices implemented based on each and every Data Pipelines nature.
- Created Spark jobs based on the talend workflow and saved cost of Talend’s license spendings.
Duration - 8 Months and in support tenure.
Team Size – 4 FTEs
Other Use Cases
Learn about how we worked with iraq’s popular telecom company in reaching their technology and hardware requirements.
