Newer
Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
17/06/09 20:10:40 INFO executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT]
17/06/09 20:10:40 INFO spark.SecurityManager: Changing view acls to: yarn,curi
17/06/09 20:10:40 INFO spark.SecurityManager: Changing modify acls to: yarn,curi
17/06/09 20:10:40 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, curi); users with modify permissions: Set(yarn, curi)
17/06/09 20:10:41 INFO spark.SecurityManager: Changing view acls to: yarn,curi
17/06/09 20:10:41 INFO spark.SecurityManager: Changing modify acls to: yarn,curi
17/06/09 20:10:41 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, curi); users with modify permissions: Set(yarn, curi)
17/06/09 20:10:41 INFO slf4j.Slf4jLogger: Slf4jLogger started
17/06/09 20:10:41 INFO Remoting: Starting remoting
17/06/09 20:10:41 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutorActorSystem@mesos-slave-07:55904]
17/06/09 20:10:41 INFO util.Utils: Successfully started service 'sparkExecutorActorSystem' on port 55904.
17/06/09 20:10:41 INFO storage.DiskBlockManager: Created local directory at /opt/hdfs/nodemanager/usercache/curi/appcache/application_1485248649253_0147/blockmgr-70293f72-844a-4b39-9ad6-fb0ad7e364e4
17/06/09 20:10:41 INFO storage.MemoryStore: MemoryStore started with capacity 17.7 GB
17/06/09 20:10:42 INFO executor.CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@10.10.34.11:48069
17/06/09 20:10:42 INFO executor.CoarseGrainedExecutorBackend: Successfully registered with driver
17/06/09 20:10:42 INFO executor.Executor: Starting executor ID 5 on host mesos-slave-07
17/06/09 20:10:42 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40984.
17/06/09 20:10:42 INFO netty.NettyBlockTransferService: Server created on 40984
17/06/09 20:10:42 INFO storage.BlockManagerMaster: Trying to register BlockManager
17/06/09 20:10:42 INFO storage.BlockManagerMaster: Registered BlockManager
17/06/09 20:10:45 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 0
17/06/09 20:10:45 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1
17/06/09 20:10:45 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 2
17/06/09 20:10:45 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 3
17/06/09 20:10:45 INFO executor.Executor: Running task 0.0 in stage 0.0 (TID 0)
17/06/09 20:10:45 INFO executor.Executor: Running task 2.0 in stage 0.0 (TID 2)
17/06/09 20:10:45 INFO executor.Executor: Running task 1.0 in stage 0.0 (TID 1)
17/06/09 20:10:45 INFO executor.Executor: Running task 3.0 in stage 0.0 (TID 3)
17/06/09 20:10:45 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 4
17/06/09 20:10:45 INFO executor.Executor: Running task 4.0 in stage 0.0 (TID 4)
17/06/09 20:10:45 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 9
17/06/09 20:10:45 INFO storage.MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 5.2 KB, free 5.2 KB)
17/06/09 20:10:45 INFO broadcast.TorrentBroadcast: Reading broadcast variable 9 took 160 ms
17/06/09 20:10:46 INFO storage.MemoryStore: Block broadcast_9 stored as values in memory (estimated size 8.8 KB, free 14.0 KB)
17/06/09 20:10:46 INFO spark.CacheManager: Partition rdd_2_1 not found, computing it
17/06/09 20:10:46 INFO spark.CacheManager: Partition rdd_2_3 not found, computing it
17/06/09 20:10:46 INFO spark.CacheManager: Partition rdd_2_0 not found, computing it
17/06/09 20:10:46 INFO spark.CacheManager: Partition rdd_2_2 not found, computing it
17/06/09 20:10:46 INFO spark.CacheManager: Partition rdd_2_4 not found, computing it
17/06/09 20:10:46 INFO rdd.HadoopRDD: Input split: hdfs://10.10.34.11:9000/pjhe/logs/2kSOSP.log:21876+7292
17/06/09 20:10:46 INFO rdd.HadoopRDD: Input split: hdfs://10.10.34.11:9000/pjhe/logs/2kSOSP.log:14584+7292
17/06/09 20:10:46 INFO rdd.HadoopRDD: Input split: hdfs://10.10.34.11:9000/pjhe/logs/2kSOSP.log:0+7292
17/06/09 20:10:46 INFO rdd.HadoopRDD: Input split: hdfs://10.10.34.11:9000/pjhe/logs/2kSOSP.log:7292+7292
17/06/09 20:10:46 INFO rdd.HadoopRDD: Input split: hdfs://10.10.34.11:9000/pjhe/logs/2kSOSP.log:29168+7292
17/06/09 20:10:46 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 8
17/06/09 20:10:46 INFO storage.MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 21.4 KB, free 35.4 KB)
17/06/09 20:10:46 INFO broadcast.TorrentBroadcast: Reading broadcast variable 8 took 19 ms
17/06/09 20:10:46 INFO storage.MemoryStore: Block broadcast_8 stored as values in memory (estimated size 281.6 KB, free 317.0 KB)
17/06/09 20:10:47 INFO Configuration.deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id
17/06/09 20:10:47 INFO Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
17/06/09 20:10:47 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
17/06/09 20:10:47 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
17/06/09 20:10:47 INFO Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 0
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 93.0 B, free 317.1 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Reading broadcast variable 0 took 21 ms
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 384.0 B, free 317.5 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 4
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 95.0 B, free 317.6 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Reading broadcast variable 4 took 18 ms
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_4 stored as values in memory (estimated size 384.0 B, free 318.0 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 3
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 152.0 B, free 318.1 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Reading broadcast variable 3 took 17 ms
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_3 stored as values in memory (estimated size 384.0 B, free 318.5 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 1
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 107.0 B, free 318.6 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Reading broadcast variable 1 took 16 ms
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 384.0 B, free 319.0 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 2
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 93.0 B, free 319.0 KB)
17/06/09 20:10:48 INFO broadcast.TorrentBroadcast: Reading broadcast variable 2 took 16 ms
17/06/09 20:10:48 INFO storage.MemoryStore: Block broadcast_2 stored as values in memory (estimated size 384.0 B, free 319.4 KB)
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 1072, boot = 856, init = 210, finish = 6
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 1114, boot = 885, init = 223, finish = 6
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 1074, boot = 869, init = 199, finish = 6
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 1078, boot = 851, init = 219, finish = 8
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 1077, boot = 865, init = 206, finish = 6
17/06/09 20:10:48 INFO storage.MemoryStore: Block rdd_2_2 stored as bytes in memory (estimated size 850.0 B, free 320.3 KB)
17/06/09 20:10:48 INFO storage.MemoryStore: Block rdd_2_3 stored as bytes in memory (estimated size 930.0 B, free 321.2 KB)
17/06/09 20:10:48 INFO storage.MemoryStore: Block rdd_2_1 stored as bytes in memory (estimated size 935.0 B, free 322.1 KB)
17/06/09 20:10:48 INFO storage.MemoryStore: Block rdd_2_0 stored as bytes in memory (estimated size 913.0 B, free 323.0 KB)
17/06/09 20:10:48 INFO storage.MemoryStore: Block rdd_2_4 stored as bytes in memory (estimated size 890.0 B, free 323.8 KB)
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 38, boot = 11, init = 27, finish = 0
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 42, boot = 12, init = 30, finish = 0
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 41, boot = 15, init = 26, finish = 0
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 40, boot = 7, init = 33, finish = 0
17/06/09 20:10:48 INFO python.PythonRunner: Times: total = 42, boot = 13, init = 28, finish = 1
17/06/09 20:10:48 INFO executor.Executor: Finished task 3.0 in stage 0.0 (TID 3). 2703 bytes result sent to driver
17/06/09 20:10:48 INFO executor.Executor: Finished task 1.0 in stage 0.0 (TID 1). 2703 bytes result sent to driver
17/06/09 20:10:48 INFO executor.Executor: Finished task 2.0 in stage 0.0 (TID 2). 2703 bytes result sent to driver
17/06/09 20:10:48 INFO executor.Executor: Finished task 4.0 in stage 0.0 (TID 4). 2703 bytes result sent to driver
17/06/09 20:10:48 INFO executor.Executor: Finished task 0.0 in stage 0.0 (TID 0). 2703 bytes result sent to driver
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 42
17/06/09 20:10:52 INFO executor.Executor: Running task 0.0 in stage 1.0 (TID 42)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 56
17/06/09 20:10:52 INFO executor.Executor: Running task 1.0 in stage 1.0 (TID 56)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 69
17/06/09 20:10:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 10
17/06/09 20:10:52 INFO executor.Executor: Running task 2.0 in stage 1.0 (TID 69)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 78
17/06/09 20:10:52 INFO executor.Executor: Running task 3.0 in stage 1.0 (TID 78)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 79
17/06/09 20:10:52 INFO executor.Executor: Running task 4.0 in stage 1.0 (TID 79)
17/06/09 20:10:52 INFO storage.MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 5.8 KB, free 329.6 KB)
17/06/09 20:10:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 10 took 17 ms
17/06/09 20:10:52 INFO storage.MemoryStore: Block broadcast_10 stored as values in memory (estimated size 9.6 KB, free 339.2 KB)
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 42, boot = -4131, init = 4172, finish = 1
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 41, boot = -4122, init = 4162, finish = 1
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 42, boot = -4121, init = 4162, finish = 1
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 42, boot = -4138, init = 4179, finish = 1
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 42, boot = -4134, init = 4175, finish = 1
17/06/09 20:10:52 INFO executor.Executor: Finished task 4.0 in stage 1.0 (TID 79). 2685 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 1.0 in stage 1.0 (TID 56). 2428 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 0.0 in stage 1.0 (TID 42). 2474 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 3.0 in stage 1.0 (TID 78). 2651 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 2.0 in stage 1.0 (TID 69). 2523 bytes result sent to driver
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 87
17/06/09 20:10:52 INFO executor.Executor: Running task 0.0 in stage 2.0 (TID 87)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 101
17/06/09 20:10:52 INFO executor.Executor: Running task 1.0 in stage 2.0 (TID 101)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 112
17/06/09 20:10:52 INFO executor.Executor: Running task 2.0 in stage 2.0 (TID 112)
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 118
17/06/09 20:10:52 INFO executor.Executor: Running task 3.0 in stage 2.0 (TID 118)
17/06/09 20:10:52 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 11
17/06/09 20:10:52 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 119
17/06/09 20:10:52 INFO executor.Executor: Running task 4.0 in stage 2.0 (TID 119)
17/06/09 20:10:52 INFO storage.MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 5.4 KB, free 344.7 KB)
17/06/09 20:10:52 INFO broadcast.TorrentBroadcast: Reading broadcast variable 11 took 15 ms
17/06/09 20:10:52 INFO storage.MemoryStore: Block broadcast_11 stored as values in memory (estimated size 9.2 KB, free 353.9 KB)
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:52 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 39, boot = -147, init = 186, finish = 0
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 39, boot = -147, init = 186, finish = 0
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 41, boot = -139, init = 179, finish = 1
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 38, boot = -156, init = 194, finish = 0
17/06/09 20:10:52 INFO python.PythonRunner: Times: total = 39, boot = -159, init = 198, finish = 0
17/06/09 20:10:52 INFO executor.Executor: Finished task 4.0 in stage 2.0 (TID 119). 2087 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 2.0 in stage 2.0 (TID 112). 2087 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 3.0 in stage 2.0 (TID 118). 2087 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 1.0 in stage 2.0 (TID 101). 2087 bytes result sent to driver
17/06/09 20:10:52 INFO executor.Executor: Finished task 0.0 in stage 2.0 (TID 87). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 122
17/06/09 20:10:53 INFO executor.Executor: Running task 0.0 in stage 3.0 (TID 122)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 136
17/06/09 20:10:53 INFO executor.Executor: Running task 1.0 in stage 3.0 (TID 136)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 150
17/06/09 20:10:53 INFO executor.Executor: Running task 2.0 in stage 3.0 (TID 150)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 158
17/06/09 20:10:53 INFO executor.Executor: Running task 3.0 in stage 3.0 (TID 158)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 12
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 159
17/06/09 20:10:53 INFO executor.Executor: Running task 4.0 in stage 3.0 (TID 159)
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 5.6 KB, free 359.4 KB)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 12 took 30 ms
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_12 stored as values in memory (estimated size 9.8 KB, free 369.3 KB)
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_6_4 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_6_3 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_6_0 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_6_1 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_6_2 not found, computing it
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 38, boot = -170, init = 208, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = -171, init = 212, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = -160, init = 200, finish = 1
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 38, boot = -172, init = 210, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 40, boot = -173, init = 213, finish = 0
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_6_4 stored as bytes in memory (estimated size 287.0 B, free 369.5 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_6_3 stored as bytes in memory (estimated size 344.0 B, free 369.9 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_6_1 stored as bytes in memory (estimated size 330.0 B, free 370.2 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_6_2 stored as bytes in memory (estimated size 252.0 B, free 370.4 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_6_0 stored as bytes in memory (estimated size 265.0 B, free 370.7 KB)
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 38, boot = 14, init = 24, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 38, boot = 12, init = 26, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = 19, init = 22, finish = 0
17/06/09 20:10:53 INFO executor.Executor: Finished task 4.0 in stage 3.0 (TID 159). 2667 bytes result sent to driver
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = 16, init = 25, finish = 0
17/06/09 20:10:53 INFO executor.Executor: Finished task 3.0 in stage 3.0 (TID 158). 2667 bytes result sent to driver
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 40, boot = 5, init = 35, finish = 0
17/06/09 20:10:53 INFO executor.Executor: Finished task 1.0 in stage 3.0 (TID 136). 2667 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 2.0 in stage 3.0 (TID 150). 2667 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 0.0 in stage 3.0 (TID 122). 2667 bytes result sent to driver
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 171
17/06/09 20:10:53 INFO executor.Executor: Running task 0.0 in stage 4.0 (TID 171)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 185
17/06/09 20:10:53 INFO executor.Executor: Running task 1.0 in stage 4.0 (TID 185)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 13
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 195
17/06/09 20:10:53 INFO executor.Executor: Running task 2.0 in stage 4.0 (TID 195)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 198
17/06/09 20:10:53 INFO executor.Executor: Running task 3.0 in stage 4.0 (TID 198)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 199
17/06/09 20:10:53 INFO executor.Executor: Running task 4.0 in stage 4.0 (TID 199)
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 5.7 KB, free 376.4 KB)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 13 took 41 ms
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_13 stored as values in memory (estimated size 10.1 KB, free 386.5 KB)
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_6_0 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_6_4 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_6_3 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_6_2 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_6_1 locally
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -141, init = 180, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 40, boot = -129, init = 169, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = -134, init = 175, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -123, init = 162, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -125, init = 166, finish = 1
17/06/09 20:10:53 INFO executor.Executor: Finished task 0.0 in stage 4.0 (TID 171). 2099 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 1.0 in stage 4.0 (TID 185). 2099 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 2.0 in stage 4.0 (TID 195). 2138 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 3.0 in stage 4.0 (TID 198). 2099 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 4.0 in stage 4.0 (TID 199). 2138 bytes result sent to driver
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 206
17/06/09 20:10:53 INFO executor.Executor: Running task 0.0 in stage 5.0 (TID 206)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 220
17/06/09 20:10:53 INFO executor.Executor: Running task 1.0 in stage 5.0 (TID 220)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 231
17/06/09 20:10:53 INFO executor.Executor: Running task 2.0 in stage 5.0 (TID 231)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 14
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 238
17/06/09 20:10:53 INFO executor.Executor: Running task 3.0 in stage 5.0 (TID 238)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 239
17/06/09 20:10:53 INFO executor.Executor: Running task 4.0 in stage 5.0 (TID 239)
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 5.8 KB, free 392.3 KB)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 14 took 12 ms
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_14 stored as values in memory (estimated size 9.6 KB, free 401.9 KB)
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -85, init = 123, finish = 1
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 40, boot = -77, init = 117, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -81, init = 119, finish = 1
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 40, boot = -78, init = 117, finish = 1
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -79, init = 120, finish = 1
17/06/09 20:10:53 INFO executor.Executor: Finished task 0.0 in stage 5.0 (TID 206). 2198 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 3.0 in stage 5.0 (TID 238). 2198 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 2.0 in stage 5.0 (TID 231). 2198 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 4.0 in stage 5.0 (TID 239). 2198 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 1.0 in stage 5.0 (TID 220). 2272 bytes result sent to driver
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 247
17/06/09 20:10:53 INFO executor.Executor: Running task 0.0 in stage 6.0 (TID 247)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 261
17/06/09 20:10:53 INFO executor.Executor: Running task 1.0 in stage 6.0 (TID 261)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 273
17/06/09 20:10:53 INFO executor.Executor: Running task 2.0 in stage 6.0 (TID 273)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 15
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 278
17/06/09 20:10:53 INFO executor.Executor: Running task 3.0 in stage 6.0 (TID 278)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 279
17/06/09 20:10:53 INFO executor.Executor: Running task 4.0 in stage 6.0 (TID 279)
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 5.4 KB, free 407.4 KB)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 15 took 15 ms
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_15 stored as values in memory (estimated size 9.2 KB, free 416.6 KB)
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -107, init = 146, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = -100, init = 141, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -99, init = 141, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -103, init = 142, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -101, init = 143, finish = 0
17/06/09 20:10:53 INFO executor.Executor: Finished task 0.0 in stage 6.0 (TID 247). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 3.0 in stage 6.0 (TID 278). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 2.0 in stage 6.0 (TID 273). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 4.0 in stage 6.0 (TID 279). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.Executor: Finished task 1.0 in stage 6.0 (TID 261). 2087 bytes result sent to driver
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 285
17/06/09 20:10:53 INFO executor.Executor: Running task 0.0 in stage 7.0 (TID 285)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 299
17/06/09 20:10:53 INFO executor.Executor: Running task 1.0 in stage 7.0 (TID 299)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 312
17/06/09 20:10:53 INFO executor.Executor: Running task 2.0 in stage 7.0 (TID 312)
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 318
17/06/09 20:10:53 INFO executor.Executor: Running task 3.0 in stage 7.0 (TID 318)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 16
17/06/09 20:10:53 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 319
17/06/09 20:10:53 INFO executor.Executor: Running task 4.0 in stage 7.0 (TID 319)
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 5.6 KB, free 422.1 KB)
17/06/09 20:10:53 INFO broadcast.TorrentBroadcast: Reading broadcast variable 16 took 13 ms
17/06/09 20:10:53 INFO storage.MemoryStore: Block broadcast_16 stored as values in memory (estimated size 9.8 KB, free 432.0 KB)
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_11_0 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_11_4 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_11_3 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_11_2 not found, computing it
17/06/09 20:10:53 INFO spark.CacheManager: Partition rdd_11_1 not found, computing it
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:53 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -110, init = 149, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 39, boot = -105, init = 144, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -103, init = 144, finish = 1
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 41, boot = -107, init = 148, finish = 0
17/06/09 20:10:53 INFO python.PythonRunner: Times: total = 42, boot = -107, init = 148, finish = 1
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_11_0 stored as bytes in memory (estimated size 152.0 B, free 432.1 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_11_3 stored as bytes in memory (estimated size 157.0 B, free 432.3 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_11_4 stored as bytes in memory (estimated size 145.0 B, free 432.4 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_11_2 stored as bytes in memory (estimated size 199.0 B, free 432.6 KB)
17/06/09 20:10:53 INFO storage.MemoryStore: Block rdd_11_1 stored as bytes in memory (estimated size 160.0 B, free 432.7 KB)
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 38, boot = 17, init = 21, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = 28, init = 13, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 38, boot = 18, init = 20, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = 19, init = 21, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = 17, init = 24, finish = 0
17/06/09 20:10:54 INFO executor.Executor: Finished task 0.0 in stage 7.0 (TID 285). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 3.0 in stage 7.0 (TID 318). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 4.0 in stage 7.0 (TID 319). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 1.0 in stage 7.0 (TID 299). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 2.0 in stage 7.0 (TID 312). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 321
17/06/09 20:10:54 INFO executor.Executor: Running task 0.0 in stage 8.0 (TID 321)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 335
17/06/09 20:10:54 INFO executor.Executor: Running task 1.0 in stage 8.0 (TID 335)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 349
17/06/09 20:10:54 INFO executor.Executor: Running task 2.0 in stage 8.0 (TID 349)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 17
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 358
17/06/09 20:10:54 INFO executor.Executor: Running task 3.0 in stage 8.0 (TID 358)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 359
17/06/09 20:10:54 INFO executor.Executor: Running task 4.0 in stage 8.0 (TID 359)
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 5.7 KB, free 438.5 KB)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Reading broadcast variable 17 took 12 ms
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_17 stored as values in memory (estimated size 10.1 KB, free 448.6 KB)
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_11_0 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_11_4 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_11_3 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_11_2 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_11_1 locally
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = -109, init = 148, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = -107, init = 148, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = -103, init = 142, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = -104, init = 144, finish = 1
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 42, boot = -107, init = 149, finish = 0
17/06/09 20:10:54 INFO executor.Executor: Finished task 0.0 in stage 8.0 (TID 321). 2141 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 2.0 in stage 8.0 (TID 349). 2141 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 4.0 in stage 8.0 (TID 359). 2141 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 3.0 in stage 8.0 (TID 358). 2141 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 1.0 in stage 8.0 (TID 335). 2111 bytes result sent to driver
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 360
17/06/09 20:10:54 INFO executor.Executor: Running task 0.0 in stage 9.0 (TID 360)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 374
17/06/09 20:10:54 INFO executor.Executor: Running task 1.0 in stage 9.0 (TID 374)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 388
17/06/09 20:10:54 INFO executor.Executor: Running task 2.0 in stage 9.0 (TID 388)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 398
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 18
17/06/09 20:10:54 INFO executor.Executor: Running task 3.0 in stage 9.0 (TID 398)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 399
17/06/09 20:10:54 INFO executor.Executor: Running task 4.0 in stage 9.0 (TID 399)
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 5.8 KB, free 454.4 KB)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Reading broadcast variable 18 took 12 ms
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_18 stored as values in memory (estimated size 9.6 KB, free 464.0 KB)
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = -73, init = 111, finish = 1
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = -75, init = 114, finish = 1
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = -75, init = 115, finish = 1
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = -75, init = 114, finish = 1
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 42, boot = -67, init = 108, finish = 1
17/06/09 20:10:54 INFO executor.Executor: Finished task 0.0 in stage 9.0 (TID 360). 2239 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 2.0 in stage 9.0 (TID 388). 2239 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 3.0 in stage 9.0 (TID 398). 2239 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 1.0 in stage 9.0 (TID 374). 2298 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 4.0 in stage 9.0 (TID 399). 2239 bytes result sent to driver
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 402
17/06/09 20:10:54 INFO executor.Executor: Running task 0.0 in stage 10.0 (TID 402)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 416
17/06/09 20:10:54 INFO executor.Executor: Running task 1.0 in stage 10.0 (TID 416)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 430
17/06/09 20:10:54 INFO executor.Executor: Running task 2.0 in stage 10.0 (TID 430)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 438
17/06/09 20:10:54 INFO executor.Executor: Running task 3.0 in stage 10.0 (TID 438)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 19
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 439
17/06/09 20:10:54 INFO executor.Executor: Running task 4.0 in stage 10.0 (TID 439)
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 5.4 KB, free 469.4 KB)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Reading broadcast variable 19 took 12 ms
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_19 stored as values in memory (estimated size 9.2 KB, free 478.6 KB)
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = -124, init = 163, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 38, boot = -123, init = 161, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = -126, init = 167, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = -127, init = 167, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = -115, init = 155, finish = 1
17/06/09 20:10:54 INFO executor.Executor: Finished task 3.0 in stage 10.0 (TID 438). 2087 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 0.0 in stage 10.0 (TID 402). 2087 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 4.0 in stage 10.0 (TID 439). 2087 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 2.0 in stage 10.0 (TID 430). 2087 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 1.0 in stage 10.0 (TID 416). 2087 bytes result sent to driver
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 450
17/06/09 20:10:54 INFO executor.Executor: Running task 0.0 in stage 11.0 (TID 450)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 464
17/06/09 20:10:54 INFO executor.Executor: Running task 1.0 in stage 11.0 (TID 464)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 475
17/06/09 20:10:54 INFO executor.Executor: Running task 2.0 in stage 11.0 (TID 475)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 478
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 20
17/06/09 20:10:54 INFO executor.Executor: Running task 3.0 in stage 11.0 (TID 478)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 479
17/06/09 20:10:54 INFO executor.Executor: Running task 4.0 in stage 11.0 (TID 479)
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.5 KB, free 416.7 KB)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Reading broadcast variable 20 took 15 ms
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_20 stored as values in memory (estimated size 9.8 KB, free 411.6 KB)
17/06/09 20:10:54 INFO spark.CacheManager: Partition rdd_16_0 not found, computing it
17/06/09 20:10:54 INFO spark.CacheManager: Partition rdd_16_4 not found, computing it
17/06/09 20:10:54 INFO spark.CacheManager: Partition rdd_16_3 not found, computing it
17/06/09 20:10:54 INFO spark.CacheManager: Partition rdd_16_2 not found, computing it
17/06/09 20:10:54 INFO spark.CacheManager: Partition rdd_16_1 not found, computing it
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = -95, init = 135, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = -96, init = 135, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 42, boot = -95, init = 137, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 42, boot = -97, init = 139, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 43, boot = -85, init = 127, finish = 1
17/06/09 20:10:54 INFO storage.MemoryStore: Block rdd_16_4 stored as bytes in memory (estimated size 263.0 B, free 386.4 KB)
17/06/09 20:10:54 INFO storage.MemoryStore: Block rdd_16_0 stored as bytes in memory (estimated size 191.0 B, free 386.6 KB)
17/06/09 20:10:54 INFO storage.MemoryStore: Block rdd_16_3 stored as bytes in memory (estimated size 232.0 B, free 386.8 KB)
17/06/09 20:10:54 INFO storage.MemoryStore: Block rdd_16_2 stored as bytes in memory (estimated size 230.0 B, free 387.0 KB)
17/06/09 20:10:54 INFO storage.MemoryStore: Block rdd_16_1 stored as bytes in memory (estimated size 351.0 B, free 387.4 KB)
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 39, boot = 22, init = 17, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = 20, init = 21, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = 20, init = 20, finish = 0
17/06/09 20:10:54 INFO executor.Executor: Finished task 4.0 in stage 11.0 (TID 479). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 41, boot = 16, init = 25, finish = 0
17/06/09 20:10:54 INFO python.PythonRunner: Times: total = 40, boot = 26, init = 14, finish = 0
17/06/09 20:10:54 INFO executor.Executor: Finished task 0.0 in stage 11.0 (TID 450). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 3.0 in stage 11.0 (TID 478). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 2.0 in stage 11.0 (TID 475). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.Executor: Finished task 1.0 in stage 11.0 (TID 464). 2667 bytes result sent to driver
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 480
17/06/09 20:10:54 INFO executor.Executor: Running task 0.0 in stage 12.0 (TID 480)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 494
17/06/09 20:10:54 INFO executor.Executor: Running task 1.0 in stage 12.0 (TID 494)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 508
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 21
17/06/09 20:10:54 INFO executor.Executor: Running task 2.0 in stage 12.0 (TID 508)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 518
17/06/09 20:10:54 INFO executor.Executor: Running task 3.0 in stage 12.0 (TID 518)
17/06/09 20:10:54 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 519
17/06/09 20:10:54 INFO executor.Executor: Running task 4.0 in stage 12.0 (TID 519)
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 5.7 KB, free 393.1 KB)
17/06/09 20:10:54 INFO broadcast.TorrentBroadcast: Reading broadcast variable 21 took 11 ms
17/06/09 20:10:54 INFO storage.MemoryStore: Block broadcast_21 stored as values in memory (estimated size 10.1 KB, free 403.2 KB)
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_16_0 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_16_4 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_16_3 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_16_2 locally
17/06/09 20:10:54 INFO storage.BlockManager: Found block rdd_16_1 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 37, boot = -162, init = 199, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -157, init = 197, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -157, init = 196, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 38, boot = -146, init = 184, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -156, init = 196, finish = 0
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 12.0 (TID 480). 2155 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 12.0 (TID 518). 2155 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 12.0 (TID 519). 2155 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 12.0 (TID 494). 2105 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 12.0 (TID 508). 2155 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 528
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 13.0 (TID 528)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 542
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 13.0 (TID 542)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 553
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 13.0 (TID 553)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 22
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 558
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 13.0 (TID 558)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 559
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 13.0 (TID 559)
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 5.8 KB, free 409.0 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 22 took 11 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_22 stored as values in memory (estimated size 9.6 KB, free 418.6 KB)
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -76, init = 114, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = -73, init = 114, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = -73, init = 114, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 41, boot = -67, init = 107, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -74, init = 113, finish = 1
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 13.0 (TID 528). 2256 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 13.0 (TID 559). 2241 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 13.0 (TID 553). 2241 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 13.0 (TID 542). 2241 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 13.0 (TID 558). 2257 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 562
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 14.0 (TID 562)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 576
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 14.0 (TID 576)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 590
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 14.0 (TID 590)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 23
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 598
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 14.0 (TID 598)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 599
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 14.0 (TID 599)
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 5.4 KB, free 378.2 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 23 took 11 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_23 stored as values in memory (estimated size 9.2 KB, free 387.4 KB)
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -90, init = 129, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -93, init = 133, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -90, init = 129, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 38, boot = -82, init = 120, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = -92, init = 133, finish = 1
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 14.0 (TID 598). 2087 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 14.0 (TID 590). 2087 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 14.0 (TID 562). 2087 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 14.0 (TID 599). 2087 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 14.0 (TID 576). 2087 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 612
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 15.0 (TID 612)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 626
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 15.0 (TID 626)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 636
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 15.0 (TID 636)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 638
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 15.0 (TID 638)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 639
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 15.0 (TID 639)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 24
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 5.6 KB, free 393.0 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 24 took 10 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_24 stored as values in memory (estimated size 9.8 KB, free 402.8 KB)
17/06/09 20:10:55 INFO spark.CacheManager: Partition rdd_21_1 not found, computing it
17/06/09 20:10:55 INFO spark.CacheManager: Partition rdd_21_4 not found, computing it
17/06/09 20:10:55 INFO spark.CacheManager: Partition rdd_21_3 not found, computing it
17/06/09 20:10:55 INFO spark.CacheManager: Partition rdd_21_2 not found, computing it
17/06/09 20:10:55 INFO spark.CacheManager: Partition rdd_21_0 not found, computing it
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -95, init = 135, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -96, init = 135, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 41, boot = -98, init = 139, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -99, init = 139, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -95, init = 135, finish = 0
17/06/09 20:10:55 INFO storage.MemoryStore: Block rdd_21_1 stored as bytes in memory (estimated size 162.0 B, free 403.0 KB)
17/06/09 20:10:55 INFO storage.MemoryStore: Block rdd_21_4 stored as bytes in memory (estimated size 200.0 B, free 403.2 KB)
17/06/09 20:10:55 INFO storage.MemoryStore: Block rdd_21_3 stored as bytes in memory (estimated size 194.0 B, free 403.4 KB)
17/06/09 20:10:55 INFO storage.MemoryStore: Block rdd_21_2 stored as bytes in memory (estimated size 163.0 B, free 403.5 KB)
17/06/09 20:10:55 INFO storage.MemoryStore: Block rdd_21_0 stored as bytes in memory (estimated size 244.0 B, free 403.8 KB)
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 38, boot = 19, init = 19, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = 20, init = 19, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 38, boot = 19, init = 19, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = 17, init = 23, finish = 0
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 15.0 (TID 626). 2667 bytes result sent to driver
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = 18, init = 24, finish = 0
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 15.0 (TID 638). 2667 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 15.0 (TID 639). 2667 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 15.0 (TID 636). 2667 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 15.0 (TID 612). 2667 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 643
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 16.0 (TID 643)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 657
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 16.0 (TID 657)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 671
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 16.0 (TID 671)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 678
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 25
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 16.0 (TID 678)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 679
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 16.0 (TID 679)
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 5.7 KB, free 409.5 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 25 took 11 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_25 stored as values in memory (estimated size 10.1 KB, free 419.6 KB)
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_21_0 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_21_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_21_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_21_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_21_1 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -104, init = 143, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 41, boot = -104, init = 145, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -106, init = 145, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -106, init = 145, finish = 0
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 43, boot = -104, init = 146, finish = 1
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 16.0 (TID 671). 2163 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 16.0 (TID 678). 2151 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 16.0 (TID 679). 2163 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 16.0 (TID 643). 2151 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 16.0 (TID 657). 2163 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 692
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 17.0 (TID 692)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 706
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 17.0 (TID 706)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 716
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 17.0 (TID 716)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 718
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 26
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 17.0 (TID 718)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 719
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 17.0 (TID 719)
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 5.8 KB, free 379.9 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 26 took 10 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_26 stored as values in memory (estimated size 9.7 KB, free 389.6 KB)
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = -69, init = 110, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 40, boot = -71, init = 110, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 39, boot = -73, init = 111, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 44, boot = -72, init = 115, finish = 1
17/06/09 20:10:55 INFO python.PythonRunner: Times: total = 42, boot = -71, init = 112, finish = 1
17/06/09 20:10:55 INFO executor.Executor: Finished task 4.0 in stage 17.0 (TID 719). 2156 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 0.0 in stage 17.0 (TID 692). 2156 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 2.0 in stage 17.0 (TID 716). 2156 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 3.0 in stage 17.0 (TID 718). 2156 bytes result sent to driver
17/06/09 20:10:55 INFO executor.Executor: Finished task 1.0 in stage 17.0 (TID 706). 2156 bytes result sent to driver
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 722
17/06/09 20:10:55 INFO executor.Executor: Running task 0.0 in stage 18.0 (TID 722)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 736
17/06/09 20:10:55 INFO executor.Executor: Running task 1.0 in stage 18.0 (TID 736)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 750
17/06/09 20:10:55 INFO executor.Executor: Running task 2.0 in stage 18.0 (TID 750)
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 758
17/06/09 20:10:55 INFO executor.Executor: Running task 3.0 in stage 18.0 (TID 758)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 27
17/06/09 20:10:55 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 759
17/06/09 20:10:55 INFO executor.Executor: Running task 4.0 in stage 18.0 (TID 759)
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 5.4 KB, free 395.0 KB)
17/06/09 20:10:55 INFO broadcast.TorrentBroadcast: Reading broadcast variable 27 took 10 ms
17/06/09 20:10:55 INFO storage.MemoryStore: Block broadcast_27 stored as values in memory (estimated size 9.2 KB, free 404.2 KB)
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:55 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 38, boot = -77, init = 115, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -76, init = 115, finish = 1
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -75, init = 115, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 42, boot = -74, init = 115, finish = 1
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 18.0 (TID 759). 2087 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 18.0 (TID 722). 2087 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 18.0 (TID 758). 2087 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 18.0 (TID 736). 2087 bytes result sent to driver
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 42, boot = -74, init = 115, finish = 1
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 18.0 (TID 750). 2087 bytes result sent to driver
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 762
17/06/09 20:10:56 INFO executor.Executor: Running task 0.0 in stage 19.0 (TID 762)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 776
17/06/09 20:10:56 INFO executor.Executor: Running task 1.0 in stage 19.0 (TID 776)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 789
17/06/09 20:10:56 INFO executor.Executor: Running task 2.0 in stage 19.0 (TID 789)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 798
17/06/09 20:10:56 INFO executor.Executor: Running task 3.0 in stage 19.0 (TID 798)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 28
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 799
17/06/09 20:10:56 INFO executor.Executor: Running task 4.0 in stage 19.0 (TID 799)
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 5.6 KB, free 409.8 KB)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Reading broadcast variable 28 took 9 ms
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_28 stored as values in memory (estimated size 9.8 KB, free 419.6 KB)
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_26_0 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_26_4 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_26_3 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_26_2 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_26_1 not found, computing it
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -79, init = 119, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -82, init = 123, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -82, init = 123, finish = 0
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_26_0 stored as bytes in memory (estimated size 16.0 B, free 419.6 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_26_3 stored as bytes in memory (estimated size 16.0 B, free 419.6 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_26_4 stored as bytes in memory (estimated size 16.0 B, free 419.6 KB)
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -67, init = 107, finish = 1
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 42, boot = -66, init = 107, finish = 1
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_26_2 stored as bytes in memory (estimated size 16.0 B, free 419.7 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_26_1 stored as bytes in memory (estimated size 16.0 B, free 419.7 KB)
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 38, boot = 23, init = 15, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 19.0 (TID 762). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = 20, init = 20, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = 23, init = 18, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 19.0 (TID 798). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 19.0 (TID 799). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = 18, init = 21, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = 18, init = 21, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 19.0 (TID 776). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 19.0 (TID 789). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 807
17/06/09 20:10:56 INFO executor.Executor: Running task 0.0 in stage 20.0 (TID 807)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 821
17/06/09 20:10:56 INFO executor.Executor: Running task 1.0 in stage 20.0 (TID 821)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 833
17/06/09 20:10:56 INFO executor.Executor: Running task 2.0 in stage 20.0 (TID 833)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 838
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 29
17/06/09 20:10:56 INFO executor.Executor: Running task 3.0 in stage 20.0 (TID 838)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 839
17/06/09 20:10:56 INFO executor.Executor: Running task 4.0 in stage 20.0 (TID 839)
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 5.7 KB, free 379.5 KB)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Reading broadcast variable 29 took 11 ms
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_29 stored as values in memory (estimated size 10.1 KB, free 374.2 KB)
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_26_0 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_26_4 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_26_3 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_26_2 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_26_1 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 38, boot = -119, init = 157, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 38, boot = -119, init = 157, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = -126, init = 165, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -111, init = 151, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -110, init = 151, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 20.0 (TID 839). 2076 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 20.0 (TID 838). 2076 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 20.0 (TID 807). 2076 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 20.0 (TID 821). 2076 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 20.0 (TID 833). 2076 bytes result sent to driver
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 853
17/06/09 20:10:56 INFO executor.Executor: Running task 0.0 in stage 21.0 (TID 853)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 867
17/06/09 20:10:56 INFO executor.Executor: Running task 1.0 in stage 21.0 (TID 867)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 877
17/06/09 20:10:56 INFO executor.Executor: Running task 2.0 in stage 21.0 (TID 877)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 878
17/06/09 20:10:56 INFO executor.Executor: Running task 3.0 in stage 21.0 (TID 878)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 30
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 879
17/06/09 20:10:56 INFO executor.Executor: Running task 4.0 in stage 21.0 (TID 879)
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 5.8 KB, free 380.0 KB)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Reading broadcast variable 30 took 8 ms
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_30 stored as values in memory (estimated size 9.7 KB, free 389.7 KB)
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 38, boot = -59, init = 96, finish = 1
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = -59, init = 98, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -59, init = 100, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -59, init = 99, finish = 1
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 21.0 (TID 853). 2348 bytes result sent to driver
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -58, init = 98, finish = 1
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 21.0 (TID 867). 2333 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 21.0 (TID 878). 2333 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 21.0 (TID 879). 2333 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 21.0 (TID 877). 2333 bytes result sent to driver
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 886
17/06/09 20:10:56 INFO executor.Executor: Running task 0.0 in stage 22.0 (TID 886)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 900
17/06/09 20:10:56 INFO executor.Executor: Running task 1.0 in stage 22.0 (TID 900)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 912
17/06/09 20:10:56 INFO executor.Executor: Running task 2.0 in stage 22.0 (TID 912)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 918
17/06/09 20:10:56 INFO executor.Executor: Running task 3.0 in stage 22.0 (TID 918)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 919
17/06/09 20:10:56 INFO executor.Executor: Running task 4.0 in stage 22.0 (TID 919)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 31
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 5.6 KB, free 395.3 KB)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Reading broadcast variable 31 took 8 ms
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_31 stored as values in memory (estimated size 9.8 KB, free 405.1 KB)
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_30_0 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_30_4 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_30_3 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_30_2 not found, computing it
17/06/09 20:10:56 INFO spark.CacheManager: Partition rdd_30_1 not found, computing it
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_0 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_4 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_3 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_2 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_2_1 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 37, boot = -88, init = 125, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = -86, init = 125, finish = 0
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_30_0 stored as bytes in memory (estimated size 324.0 B, free 405.4 KB)
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = -86, init = 125, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = -84, init = 125, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -85, init = 125, finish = 0
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_30_1 stored as bytes in memory (estimated size 165.0 B, free 405.6 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_30_2 stored as bytes in memory (estimated size 250.0 B, free 405.8 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_30_4 stored as bytes in memory (estimated size 226.0 B, free 406.0 KB)
17/06/09 20:10:56 INFO storage.MemoryStore: Block rdd_30_3 stored as bytes in memory (estimated size 251.0 B, free 406.3 KB)
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = 19, init = 21, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = 20, init = 19, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = 21, init = 18, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 22.0 (TID 886). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 41, boot = 18, init = 23, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = 18, init = 22, finish = 0
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 22.0 (TID 900). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 22.0 (TID 912). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 22.0 (TID 919). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 22.0 (TID 918). 2667 bytes result sent to driver
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 926
17/06/09 20:10:56 INFO executor.Executor: Running task 0.0 in stage 23.0 (TID 926)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 940
17/06/09 20:10:56 INFO executor.Executor: Running task 1.0 in stage 23.0 (TID 940)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 32
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 951
17/06/09 20:10:56 INFO executor.Executor: Running task 2.0 in stage 23.0 (TID 951)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 958
17/06/09 20:10:56 INFO executor.Executor: Running task 3.0 in stage 23.0 (TID 958)
17/06/09 20:10:56 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 959
17/06/09 20:10:56 INFO executor.Executor: Running task 4.0 in stage 23.0 (TID 959)
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 5.7 KB, free 406.3 KB)
17/06/09 20:10:56 INFO broadcast.TorrentBroadcast: Reading broadcast variable 32 took 16 ms
17/06/09 20:10:56 INFO storage.MemoryStore: Block broadcast_32 stored as values in memory (estimated size 10.1 KB, free 400.4 KB)
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_30_0 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_30_3 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_30_2 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_30_1 locally
17/06/09 20:10:56 INFO storage.BlockManager: Found block rdd_30_4 locally
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 39, boot = -134, init = 173, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -130, init = 170, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -132, init = 172, finish = 0
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 42, boot = -132, init = 173, finish = 1
17/06/09 20:10:56 INFO python.PythonRunner: Times: total = 40, boot = -129, init = 168, finish = 1
17/06/09 20:10:56 INFO executor.Executor: Finished task 0.0 in stage 23.0 (TID 926). 2211 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 2.0 in stage 23.0 (TID 951). 2223 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 3.0 in stage 23.0 (TID 958). 2223 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 4.0 in stage 23.0 (TID 959). 2223 bytes result sent to driver
17/06/09 20:10:56 INFO executor.Executor: Finished task 1.0 in stage 23.0 (TID 940). 2223 bytes result sent to driver
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 970
17/06/09 20:10:57 INFO executor.Executor: Running task 0.0 in stage 24.0 (TID 970)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 984
17/06/09 20:10:57 INFO executor.Executor: Running task 1.0 in stage 24.0 (TID 984)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 998
17/06/09 20:10:57 INFO executor.Executor: Running task 2.0 in stage 24.0 (TID 998)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1012
17/06/09 20:10:57 INFO executor.Executor: Running task 3.0 in stage 24.0 (TID 1012)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1026
17/06/09 20:10:57 INFO executor.Executor: Running task 4.0 in stage 24.0 (TID 1026)
17/06/09 20:10:57 INFO broadcast.TorrentBroadcast: Started reading broadcast variable 33
17/06/09 20:10:57 INFO storage.MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 29.5 KB, free 404.8 KB)
17/06/09 20:10:57 INFO broadcast.TorrentBroadcast: Reading broadcast variable 33 took 9 ms
17/06/09 20:10:57 INFO storage.MemoryStore: Block broadcast_33 stored as values in memory (estimated size 82.1 KB, free 486.9 KB)
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_6_4 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_6_3 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_6_2 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_6_1 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_6_0 locally
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 40, boot = -340, init = 380, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 40, boot = -337, init = 376, finish = 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 42, boot = -343, init = 384, finish = 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 39, boot = -342, init = 381, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 41, boot = -343, init = 384, finish = 0
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000003_1012' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000003
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000004_1026' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000004
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000002_998' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000002
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000000_970' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000000
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000001_984' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000001
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000004_1026: Committed
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000002_998: Committed
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000003_1012: Committed
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000001_984: Committed
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000000_970: Committed
17/06/09 20:10:57 INFO executor.Executor: Finished task 3.0 in stage 24.0 (TID 1012). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 4.0 in stage 24.0 (TID 1026). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 1.0 in stage 24.0 (TID 984). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 2.0 in stage 24.0 (TID 998). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 0.0 in stage 24.0 (TID 970). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1125
17/06/09 20:10:57 INFO executor.Executor: Running task 40.0 in stage 24.0 (TID 1125)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1126
17/06/09 20:10:57 INFO executor.Executor: Running task 41.0 in stage 24.0 (TID 1126)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1127
17/06/09 20:10:57 INFO executor.Executor: Running task 42.0 in stage 24.0 (TID 1127)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1128
17/06/09 20:10:57 INFO executor.Executor: Running task 43.0 in stage 24.0 (TID 1128)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1129
17/06/09 20:10:57 INFO executor.Executor: Running task 44.0 in stage 24.0 (TID 1129)
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_11_0 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_11_1 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_11_2 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_11_3 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_11_4 locally
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 39, boot = -397, init = 436, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 38, boot = -405, init = 443, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 40, boot = -400, init = 440, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 38, boot = -390, init = 428, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 41, boot = -398, init = 439, finish = 0
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000044_1129' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000044
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000044_1129: Committed
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000043_1128' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000043
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000040_1125' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000040
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000043_1128: Committed
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000040_1125: Committed
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000042_1127' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000042
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000042_1127: Committed
17/06/09 20:10:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000041_1126' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000041
17/06/09 20:10:57 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000041_1126: Committed
17/06/09 20:10:57 INFO executor.Executor: Finished task 44.0 in stage 24.0 (TID 1129). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 43.0 in stage 24.0 (TID 1128). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 40.0 in stage 24.0 (TID 1125). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 42.0 in stage 24.0 (TID 1127). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.Executor: Finished task 41.0 in stage 24.0 (TID 1126). 2364 bytes result sent to driver
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1135
17/06/09 20:10:57 INFO executor.Executor: Running task 80.0 in stage 24.0 (TID 1135)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1136
17/06/09 20:10:57 INFO executor.Executor: Running task 81.0 in stage 24.0 (TID 1136)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1137
17/06/09 20:10:57 INFO executor.Executor: Running task 82.0 in stage 24.0 (TID 1137)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1138
17/06/09 20:10:57 INFO executor.Executor: Running task 83.0 in stage 24.0 (TID 1138)
17/06/09 20:10:57 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1141
17/06/09 20:10:57 INFO executor.Executor: Running task 84.0 in stage 24.0 (TID 1141)
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_16_0 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_16_1 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_16_2 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_16_3 locally
17/06/09 20:10:57 INFO storage.BlockManager: Found block rdd_16_4 locally
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 37, boot = -87, init = 124, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 39, boot = -79, init = 118, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 39, boot = -86, init = 125, finish = 0
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 42, boot = -81, init = 122, finish = 1
17/06/09 20:10:57 INFO python.PythonRunner: Times: total = 41, boot = -83, init = 123, finish = 1
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000083_1138' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000083
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000083_1138: Committed
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000084_1141' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000084
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000080_1135' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000080
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000084_1141: Committed
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000080_1135: Committed
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000082_1137' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000082
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000082_1137: Committed
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000081_1136' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000081
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000081_1136: Committed
17/06/09 20:10:58 INFO executor.Executor: Finished task 83.0 in stage 24.0 (TID 1138). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO executor.Executor: Finished task 84.0 in stage 24.0 (TID 1141). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO executor.Executor: Finished task 80.0 in stage 24.0 (TID 1135). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO executor.Executor: Finished task 82.0 in stage 24.0 (TID 1137). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO executor.Executor: Finished task 81.0 in stage 24.0 (TID 1136). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1145
17/06/09 20:10:58 INFO executor.Executor: Running task 120.0 in stage 24.0 (TID 1145)
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1146
17/06/09 20:10:58 INFO executor.Executor: Running task 121.0 in stage 24.0 (TID 1146)
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1147
17/06/09 20:10:58 INFO executor.Executor: Running task 122.0 in stage 24.0 (TID 1147)
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1150
17/06/09 20:10:58 INFO executor.Executor: Running task 123.0 in stage 24.0 (TID 1150)
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1151
17/06/09 20:10:58 INFO executor.Executor: Running task 124.0 in stage 24.0 (TID 1151)
17/06/09 20:10:58 INFO storage.BlockManager: Found block rdd_21_4 locally
17/06/09 20:10:58 INFO storage.BlockManager: Found block rdd_21_1 locally
17/06/09 20:10:58 INFO storage.BlockManager: Found block rdd_21_0 locally
17/06/09 20:10:58 INFO storage.BlockManager: Found block rdd_21_2 locally
17/06/09 20:10:58 INFO storage.BlockManager: Found block rdd_21_3 locally
17/06/09 20:10:58 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:58 INFO python.PythonRunner: Times: total = 40, boot = -82, init = 122, finish = 0
17/06/09 20:10:58 INFO output.FileOutputCommitter: Saved output of task 'attempt_201706092018_0024_m_000124_1151' to hdfs://10.10.34.11:9000/pjhe/test/1/_temporary/0/task_201706092018_0024_m_000124
17/06/09 20:10:58 INFO mapred.SparkHadoopMapRedUtil: attempt_201706092018_0024_m_000124_1151: Committed
17/06/09 20:10:58 INFO executor.Executor: Finished task 124.0 in stage 24.0 (TID 1151). 2364 bytes result sent to driver
17/06/09 20:10:58 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:58 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:58 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:58 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
17/06/09 20:10:58 INFO executor.CoarseGrainedExecutorBackend: Got assigned task 1155
17/06/09 20:10:58 INFO executor.Executor: Running task 160.0 in stage 24.0 (TID 1155)