Skip to content

Commit

Permalink
SPARK-1770: Revert accidental(?) fix
Browse files Browse the repository at this point in the history
Looks like this change was accidentally committed here: apache@06b15ba
but the change does not show up in the PR itself (apache#704).

Other than not intending to go in with that PR, this also broke the test JavaAPISuite.repartition.

Author: Aaron Davidson <[email protected]>

Closes apache#716 from aarondav/shufflerand and squashes the following commits:

b1cf70b [Aaron Davidson] SPARK-1770: Revert accidental(?) fix
  • Loading branch information
aarondav committed May 9, 2014
1 parent bd67551 commit 59577df
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions core/src/main/scala/org/apache/spark/rdd/RDD.scala
Original file line number Diff line number Diff line change
Expand Up @@ -330,9 +330,9 @@ abstract class RDD[T: ClassTag](
if (shuffle) {
// include a shuffle step so that our upstream tasks are still distributed
new CoalescedRDD(
new ShuffledRDD[Int, T, (Int, T)](map(x => (Utils.random.nextInt(), x)),
new ShuffledRDD[T, Null, (T, Null)](map(x => (x, null)),
new HashPartitioner(numPartitions)),
numPartitions).values
numPartitions).keys
} else {
new CoalescedRDD(this, numPartitions)
}
Expand Down

0 comments on commit 59577df

Please sign in to comment.