Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

My own development branch of the well known WPF document docking library

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Visualizes the Random Forest debug string from the MLLib in Spark using D3.js

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

dllib is a distributed deep learning library running on Apache Spark

This repository contains Spark, MLlib, PySpark and Dataframes projects

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

spark (scala and python)

Feature engineering toolkit for Spark MLlib.

Python3, NetworkX, Java, MLlib, Spark, Cassandra, Neo4j 3.0, Gephi, Docker

A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

Example from Spark MLLib (in python)

Slides, code and more for my class: Data Analytics and Machine Learning on Big Data

Implementation of Inferring Networks of Substitutable and Complementary Products Model paper

spark机器学习

kaggle machine learning with spark

Prediction of Customer Churn using Spark Mllib

Integrating SMILE and Spark

Basics of Big Data and Machine Learning using Apache Spark and Scala

[2009] Code apps and games easily on Nintendo Wii !

Launched a distributed application using Spark and MLlib ALS recommendation engine to analyze a complex dataset of 10 million movie ratings from MovieLens.

In this tutorial, I explained SparkContext by using map and filter methods with Lambda functions in Python and created RDD from object and external files, transformations and actions on RDD and pair RDD, PySpark DataFrame from RDD and external files, used sql queries with DataFrames by using Spark SQL, used machine learning with PySpark MLlib.

Spark core sql streaming mllib

PCARD Ensemble classifier for Big Data

Class project for Data 603 @ UMBC on Big Data Twitter Stream Sentiment Analysis

Compares Execution time for MapReduce, Hive and spark. Plus do sentimental analysis on any Youtube video