Author Image
Hello

I'm Kiran Kumar Vasadi

Analytics & Big Data Engineer

Hello! I’m Kiran Kumar Vasadi. Analytics & Big Data Engineer Google Certified Cloud Architect with over 15 years of experience specializing in Apache Hadoop and Spark, Google Cloud Platform, Azure Cloud. Experienced with all stages of the development cycle for Data Engineering Projects.Having an in-depth knowledge including advanced Hadoop, Spark, Google Cloud Platform, Big Query, Airflow, SQL Server SSIS, SSRS, Power BI, Tableau, Talend.. Excellent problem-solving, organizational and analytical skills, with the ability to evolve product strategy based on research, data and industry trends.

Professional Skills

GCP Products: Dataproc, Cloud SQL, BigQuery, Bigtable, Spanner
Azure HDinsight, DataFactory, DataLake, SQL Warehouse, U-SQL
Hadoop, Sqoop, Hive, Hbase, Pig
Spark Scala, Spark SQL, Spark PySpark, Spark Streaming
Data Warehouse Migration
Talend Bigdata ETL
Tableau & PowerBI & Cognos Visualization
SQL Server, SSIS, SSRS

My Experience

  • My Contribution in Data Engineering World

  • 2017 - Present

    GSPANN Technologies, Inc.

    • Acquired Extensive knowledge on Retail Domain and provided solutions for designing models for Analytics

    • Data analysis, Data modeling and implementation of enterprise class systems spanning Big Data, Data Integration

    • Extensive working experience in Hadoop eco-system components like MapReduce, Hive, HBase, Sqoop, Pig, Spark-SQL.

    • In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming.

    • Expertise in writing Spark RDD transformations, actions, Data Frames, case classes for the required input data and performed the data transformations using Spark-Core.

    • Expertise knowledge on the parsing of JSON, XML, ORC, AVRO file formats in Hadoop Environment.

    • Extensive Knowledge in developing Stored Procedures and Tuning SQL queries, T-SQL, U-SQL

    • Experience in using recursive CTEs, CTE, temp tables and effective DDL/DML Triggers to facilitate efficient data manipulation and data consistency as well as to support the existing applications.

    • Proven ability to quickly learn New Technologies and apply them in Business Solutions.

    • Part of COE bigdata practice team where get aligned to multiple projects for Installation, configuration, enable security on multiple bigdata tools.

    • Involved in multiple RFP and POC activities.

  • 2017 - 2020

    Google Cloud Platform

    • Expertise working on migration activity of on-premise data warehouse to Hadoop Google Cloud Platform

    • Desined MVP Orchestration to migration from SQL server to Bigquery

    • Implemented Apache Airflow End to End pipeline using Python.

    • Data Injection to Google Big Query for analytics using Cloud Tableau

    • Developing high-performance SQL scripts in BigQuery for Tableau Visualization

    • Implemented Aggregation Tables using Complex SQL's from Hive to Bigquery for Tableau Visualization

    • Implemented Data Injection from Hive ORC file mechanism to BigQuery using BQ Commands

    • Data Injection to Cloud SQL from Mysql Database

    • Designed Relation Model in Cloud Spanner

  • 2017 - 2020

    Azure Cloud

    • Worked as Independent Contributor, communicating with the clients for Requirements gathering and Implementing BigData in Azure HDInsight

    • Architect solutions using MS Azure PaaS services such as SQL Server, HDInsight

    • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.

    • Expertise in creating HDInsight cluster and Storage Account with End-to-End environment for running the jobs.

    • Data Migration from On-Prem to Data Lake for Analytics to SQL Warehouse

    • Implemented Analytical Reports and Dashboards using Power BI

    • Implemented Similar SSIS Transformation in HDinsight using Shell script for Data Injection from SQL server to Hive

    • Provided Most Valuable Products Orchestration on Azure

    • Best Practices and Recommendations on Azure Components

    • Extensively worked on OMS Order Management System End to End flow

  • RealPage Inc

  • 2011 - 2016

    Big Data Hadoop Developer

    • Proactively, initiate, develop and maintain effective working relationships with team members. Coordinate with all team members, including 3rd party suppliers

    • Good understanding of Classic Hadoop and Yarn architecture along with various Hadoop Demons such as Job Tracker, Task Tracker, Name Node, Data Node, Secondary Name Node, Resource Manager, Node Manager, Application Master and Containers.

    • Involved in Migrating Data from SQL Server to Azure HDinsight to Hive

    • Involved in Implementing similar SSIS Transformation in HDinsight using Shell script and SQOOP for injection data from SQL server to Hive

    • Hands on experience in installing configuring and using Hadoop ecosystem components like Hadoop MapReduce HDFS HBase Hive Sqoop Pig

  • 2011 - 2016

    Business Intelligence Developer

    • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.

    • Developing Scripts and Batch Job to schedule various Hadoop Program.

    • Written Hive queries for data analysis to meet the business requirements.

    • Creating Hive tables and working on them using Hive QL.

    • Developed Complex Stored Procedures to fulfill client Solutions in SSRS Reports.

    • Developed the SQL Server Integration Services (SSIS) packages to transform data from MySQL to MS SQL 2008 as well as Created interface stored procedures used in SSIS to load/transform data to the database.

    • Ensuring that the reports that have to be delivered to the client are of excellent quality and comply with the requirements.

  • Wipro Technologies

  • 2010 - 2011

    Business Analyst

    • Developing Business Intelligence Report as per Business Analysts Requirements (UBS - United Bank of Switzerland )

    • Developed Complex reports on SSRS using High level Stored Procedures to meet complex requirements.

    • Create Busines Intelligence solutions including Executive Dashboards and Business Scorecards with MS Excel.

    • Perform ETL operations for Business Intelligence reporting solutions using custom VBA and Excel web queries.

    • Create ad-hoc queries from SQL Server databases for custom reporting needs.

  • Aim Software Solutions

  • 2008 - 2011

    Database Developer

    • Developed physical data models and created DDL scripts to create database schema and database objects Created various Filters in the Framework Manager.

    • Designed data models using Erwin

    • Created new tables, written stored procedures, triggers for Application Developers and some user defined functions. Created SQL scripts for tuning and scheduling.

    • Involved in performing data conversions from flat files into a normalized database structure.

    • Extensively used Joins and sub-Queries to simplify complex queries involving multiple tables and also optimized the procedures and triggers to be used in production

    • Managing historical data from various heterogeneous data sources (i.e. Excel, Access)

    • Involved in designing Parameterized Reports and Report Models for generating Ad-Hoc reports as per the client requirements

    • Developed Stored Procedures to generate various Drill-through reports, Parameterized reports, Tabular reports and Matrix reports using SSRS.

    • Testing and improving Report performance

  • Achievements & Certifications

  • Certifications

    • Google Cloud Certified Professional Cloud Architect

    • Google Cloud Certified Professional Data Engineer

    • IBM Certified - Cognos BI Certified Author

    • Microsoft Certified SQL Server, Business Intelligence Developer

  • Achievements

    • Secured 1st Prize in Open Software Contest in CONCOURS 2005, a National Level Technical Festival Organised by Computer society of India.

    • Secured 1st Prize as a Best Programmer award from the Regional Joint Director for Technical Board and Felicitated on the valuable dais in the year 2000, when I am studying Polytechnic.

    • Active member of NSS (National Social Service).

    • Worked as an Organising Committee in Engineering and Beyond 2005.

    • Worked as an Design desk in TECHKIET a Technical Magazine.

My Interest

First of all I love music, Classic Melody music is my favorite. Love watching Technical Videos, Blogging and playing games with my buddies. I spend quite a lot of time in traveling and photography, these keeps me fresh for working environment. When I feel free, also spend time in cooking and enjoying with friends..

  • Music
  • Gaming
  • Photo
  • Football
  • Traveling
  • Movies

From My Blog

No posts.
No posts.

Testimonials

eBooks

GCP pdf
  • Complete documentation
  • Working materials in PDF and Sketch format
* Great for beginners!
Azure pdf
  • Complete documentation
  • Working materials in PDF and Sketch format
* Most popular!
Hadoop pdf
  • Complete documentation
  • Working materials in PDF and Sketch format

Get in Touch

Name*


Message*


Feel free To Contact

If you have any questions about my service, feel free to contact me anytime. Simply use the form to the left, or one of the methods below.!

  • Hyderabad, Telangana 500009, India.
  • +91-897-708-1119
  • kirankumarvasadi@gmail.com
  • www.kiranvasadi.blogspot.com
Created By Kiran Kumar Vasadi | Developed By Kiran Kumar Vasadi