Apache Spark
Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,742 public repositories matching this topic...
-
Updated
May 13, 2021 - Python
-
Updated
Jun 21, 2021 - Python
-
Updated
Jun 12, 2021 - Go
-
Updated
Jun 22, 2021 - Python
Describe the bug
If I pass 'Next 7 days' into the dateRange in query, the response is not a range over the next 7 days but only the day IN 7 days.
To Reproduce
Steps to reproduce the behavior:
- Build a query like this:
const query: Query = {
measures: [
measure
],
timeDimensions: [
{
dimension: 'Your.Dimension,
dateRange: 'Next 7
-
Updated
Jun 4, 2021 - Java
-
Updated
Oct 31, 2019
-
Updated
Jun 20, 2021 - Java
-
Updated
Jun 3, 2021
-
Updated
Jun 22, 2021 - Java
-
Updated
Dec 23, 2020 - Python
-
Updated
Jun 22, 2021 - Jupyter Notebook
-
Updated
Jun 22, 2021 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Jun 22, 2021 - Scala
-
Updated
Jun 21, 2021 - Python
- Delta Lake 1.0.0
- Spark 3.1.2
- Scala 2.12
- AdoptOpenJDK-11.0.11+9 (build 11.0.11+9)
The following code gives a NullPointerException. This is for a directory-based delta table that does not exist and uses a generated column.
import io.delta.tables.DeltaTable
DeltaTable.create
.addColumn(
DeltaTable.columnBuilder("value")
.generatedAlwaysAs("true")
.nullab
-
Updated
May 26, 2019 - Scala
-
Updated
Mar 31, 2021 - JavaScript
-
Updated
May 12, 2021 - Jupyter Notebook
Flaky unit tests
Travis CI tests are very flaky lately and need some additional check/debugging.
Some of the tests, which are failing:
[info] - should start job, return JobStarted (async) and invoke callback *** FAILED *** (161 milliseconds)
[info] 0 was not equal to 1 (JobManagerActorSpec.scala:487)
[info] org.scalatest.exceptions.TestFailedException:
[info] at org.scalatest.MatchersHelper$.
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia


At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.