.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

MCW Big data and visualization

AzureSMR is no longer being actively developed. For ongoing support of Azure in R, see: https://github.com/Azure/AzureR

HDInsight Kafka Tools

C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

Java client for submitting a remote job to HDInsight Spark cluster via Livy.

Azure ARM template to deploy Kafka and Spark clusters in same VNet with ADLS

Microsoft Big Data, Data Scientist, and AI

This is the companion repo for HDInsight Succinctly by James Beresford. Published by Syncfusion.

BigData Blog articles

TopN Products by category using HDInsight Streaming MapReduce

Get date wise number of reviews in the descending order using HDInsight

Top N OverPriced Products Using HDInsight streaming MapReduce Job

Microsoft edx course DAT202.1x

Configure local jupyter with HDInsight Spark cluster

This is a grocery store data generator for emulating batch and real-time POS transactions and sending them to either Azure Event Hubs or Apache Kafka (test with Azure HDInsight Kafka)

Creates an HDInsight cluster that has an external Hive metastore and access to Azure Data Lake Store

HDInsight provider for Airflow

Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

An airflow DAG transformation framework

Automated TPC-DS and TPC-H benchmark for Apache Hive LLAP

Creates a HDInsight cluster then runs distcp remotely to copy data between blob and/or data lake (ADLS)

Run a job in Spark 2.x with HDInsight and submit the job through Livy

How to share an HDInsight Hive Metastore with Azure Databricks

HDInsight code lab and crash course for using Apache Spark, Apache Storm, Apache Hadoop-HBase. ~ 📖 ~

Short documentation on Microsoft's Azure HDInsight

Gets a base 64 encoding from a PFX. Useful for when you have a service principle in Azure and need to put the base 64 in an ARM template

Azure Analytics (azure_cloud_utils)