Newer
Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
[INFO]2023-08-20 02:29:52,384 main.py:45: ------- OnlineBoutique Result at inner service level -------
[INFO]2023-08-20 02:30:16,312 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:30:35,701 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:30:51,481 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:31:01,994 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:31:02,218 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '104_106', 'score': 0.7028169014084507, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:31:02,276 pattern_ranker.py:260: 2022-08-22 03:53:10 Inject RCA Result:
[INFO]2023-08-20 02:31:02,277 pattern_ranker.py:262: 2022-08-22 03:53:10 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention
[INFO]2023-08-20 02:31:02,277 pattern_ranker.py:277: 2022-08-22 03:53:10 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention score 1
[INFO]2023-08-20 02:31:02,277 pattern_ranker.py:315: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:31:02,277 pattern_ranker.py:318: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: currencyservice hipstershop.CurrencyService/Carry start, score: 0.7028169014084507, deepth: 2, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:31:02,277 pattern_ranker.py:326:
[INFO]2023-08-20 02:31:14,853 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:31:29,398 data_integrate.py:550: Data Integrate Complete!
[ERROR]2023-08-20 02:31:31,177 pattern_ranker.py:191: Catch an exception: pop index out of range
[INFO]2023-08-20 02:31:31,178 pattern_ranker.py:198: Soted Result List: [{'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_119', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_120', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '18_78', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_17', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_80', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_82', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_86', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:31:31,269 pattern_ranker.py:260: 2022-08-22 04:02:07 Inject RCA Result:
[INFO]2023-08-20 02:31:31,269 pattern_ranker.py:262: 2022-08-22 04:02:07 Inject Ground Truth: frontend-579b9bff58-t2dbm, return
[INFO]2023-08-20 02:31:31,269 pattern_ranker.py:293: 2022-08-22 04:02:07 Inject Ground Truth: frontend-579b9bff58-t2dbm, return score 2
[INFO]2023-08-20 02:31:31,269 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdServiceImpl/getAds end, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdService/<:SPANID:> start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.ProductCatalogService/GetProduct start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,270 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/GetSupportedCurrencies start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CartService/GetCart start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,271 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,272 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.RecommendationService/ListRecommendations start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,272 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:31:31,272 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:31:31,272 pattern_ranker.py:326:
[INFO]2023-08-20 02:31:48,315 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:32:03,874 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:32:04,166 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.75, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:32:04,236 pattern_ranker.py:260: 2022-08-22 04:10:20 Inject RCA Result:
[INFO]2023-08-20 02:32:04,236 pattern_ranker.py:262: 2022-08-22 04:10:20 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed
[INFO]2023-08-20 02:32:04,236 pattern_ranker.py:277: 2022-08-22 04:10:20 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed score 1
[INFO]2023-08-20 02:32:04,237 pattern_ranker.py:315: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:32:04,237 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.75, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:32:04,237 pattern_ranker.py:326:
[INFO]2023-08-20 02:32:26,775 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:32:47,129 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:32:47,215 pattern_ranker.py:198: Soted Result List: [{'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:32:47,316 pattern_ranker.py:260: 2022-08-22 04:18:35 Inject RCA Result:
[INFO]2023-08-20 02:32:47,316 pattern_ranker.py:262: 2022-08-22 04:18:35 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception
[INFO]2023-08-20 02:32:47,316 pattern_ranker.py:293: 2022-08-22 04:18:35 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception score 1
[INFO]2023-08-20 02:32:47,316 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:32:47,317 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:32:47,317 pattern_ranker.py:326:
[INFO]2023-08-20 02:33:08,037 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:33:25,665 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:33:26,201 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'NetworkP90(ms)'}, {'events': '24_100', 'score': 1.0, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:260: 2022-08-22 04:27:03 Inject RCA Result:
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:262: 2022-08-22 04:27:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:277: 2022-08-22 04:27:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay score 1
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:315: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 1.0, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:33:26,282 pattern_ranker.py:326:
[INFO]2023-08-20 02:33:49,634 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:34:11,344 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:34:11,677 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:34:11,770 pattern_ranker.py:260: 2022-08-22 04:36:03 Inject RCA Result:
[INFO]2023-08-20 02:34:11,771 pattern_ranker.py:262: 2022-08-22 04:36:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention
[INFO]2023-08-20 02:34:11,771 pattern_ranker.py:277: 2022-08-22 04:36:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention score 1
[INFO]2023-08-20 02:34:11,771 pattern_ranker.py:315: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:34:11,771 pattern_ranker.py:326:
[INFO]2023-08-20 02:34:34,442 data_integrate.py:481: [{'pod': 'checkoutservice-578fcf4766-9csqn', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:34:55,274 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:34:55,683 pattern_ranker.py:198: Soted Result List: [{'events': '158_65', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:34:55,774 pattern_ranker.py:260: 2022-08-22 04:44:16 Inject RCA Result:
[INFO]2023-08-20 02:34:55,774 pattern_ranker.py:262: 2022-08-22 04:44:16 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_contention
[INFO]2023-08-20 02:34:55,774 pattern_ranker.py:277: 2022-08-22 04:44:16 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_contention score 1
[INFO]2023-08-20 02:34:55,774 pattern_ranker.py:315: source :checkoutservice hipstershop.CheckoutService/ConvertCurrency start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Start convert currency from currency code:<:ITEM:>, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:34:55,774 pattern_ranker.py:326:
[INFO]2023-08-20 02:35:20,009 data_integrate.py:481: [{'pod': 'checkoutservice-578fcf4766-9csqn', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:35:41,973 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:35:42,375 pattern_ranker.py:198: Soted Result List: [{'events': '158_65', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:35:42,474 pattern_ranker.py:260: 2022-08-22 04:52:55 Inject RCA Result:
[INFO]2023-08-20 02:35:42,474 pattern_ranker.py:262: 2022-08-22 04:52:55 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, network_delay
[INFO]2023-08-20 02:35:42,474 pattern_ranker.py:277: 2022-08-22 04:52:55 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, network_delay score 1
[INFO]2023-08-20 02:35:42,474 pattern_ranker.py:315: source :checkoutservice hipstershop.CheckoutService/ConvertCurrency start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Start convert currency from currency code:<:ITEM:>, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:35:42,474 pattern_ranker.py:326:
[INFO]2023-08-20 02:36:05,885 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'currencyservice-cf787dd48-vpjrd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:36:25,614 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:36:26,575 pattern_ranker.py:198: Soted Result List: [{'events': '62_61', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '62_150', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_60', 'score': 1.0, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '104_23', 'score': 1.0, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd', 'resource': 'CpuUsageRate(%)'}, {'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:36:26,661 pattern_ranker.py:260: 2022-08-22 05:01:13 Inject RCA Result:
[INFO]2023-08-20 02:36:26,661 pattern_ranker.py:262: 2022-08-22 05:01:13 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, exception
[INFO]2023-08-20 02:36:26,661 pattern_ranker.py:293: 2022-08-22 05:01:13 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, exception score 1
[INFO]2023-08-20 02:36:26,661 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Charge successfully, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:36:26,662 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to connect payment service: connect error.
[INFO]2023-08-20 02:36:26,662 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: checkoutservice hipstershop.PaymentService/Charge start, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:36:26,662 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to connect payment service: connect error.
[INFO]2023-08-20 02:36:26,662 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Payment went through (transaction id: <:*:>, score: 1.0, deepth: 3, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:36:26,662 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: checkoutservice hipstershop.CheckoutService/PlaceOrder end
[INFO]2023-08-20 02:36:26,663 pattern_ranker.py:315: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, score: 1.0, deepth: 2, pod currencyservice-cf787dd48-vpjrd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:36:26,663 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:36:26,663 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:36:26,663 pattern_ranker.py:326:
[INFO]2023-08-20 02:36:50,044 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:37:10,713 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:37:10,878 pattern_ranker.py:198: Soted Result List: [{'events': '62_61', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_60', 'score': 1.0, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:260: 2022-08-22 05:09:50 Inject RCA Result:
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:262: 2022-08-22 05:09:50 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, return
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:293: 2022-08-22 05:09:50 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, return score 1
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Charge successfully, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not charge the card: charge card error.
[INFO]2023-08-20 02:37:10,979 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Payment went through (transaction id: <:*:>, score: 1.0, deepth: 3, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:37:10,980 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: checkoutservice hipstershop.CheckoutService/PlaceOrder end
[INFO]2023-08-20 02:37:10,980 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:10,980 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:37:10,980 pattern_ranker.py:326:
[INFO]2023-08-20 02:37:15,655 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'currencyservice-cf787dd48-vpjrd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:37:18,728 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:37:21,344 pattern_ranker.py:198: Soted Result List: [{'events': '104_23', 'score': 1.0, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd', 'resource': 'CpuUsageRate(%)'}, {'events': '4_18', 'score': 0.8644688644688645, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 0.8644688644688645, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '120_198', 'score': 0.8567493112947658, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '4_3', 'score': 0.8285714285714286, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '76_4', 'score': 0.8116883116883117, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '69_146', 'score': 0.7924528301886793, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '69_158', 'score': 0.7924528301886793, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '38_84', 'score': 0.7769607843137255, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:260: 2022-08-22 05:18:09 Inject RCA Result:
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:262: 2022-08-22 05:18:09 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, cpu_contention
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:277: 2022-08-22 05:18:09 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, cpu_contention score 1
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:315: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, score: 1.0, deepth: 2, pod currencyservice-cf787dd48-vpjrd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, score: 0.8644688644688645, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:21,379 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page complete, score: 0.8644688644688645, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 0.8567493112947658, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Adding to cart started, score: 0.8285714285714286, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:318: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 0.8116883116883117, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.ProductCatalogService/GetProduct start, score: 0.7924528301886793, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.CheckoutService/ConvertCurrency start, score: 0.7924528301886793, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, target: frontend hipstershop.CurrencyService/Convert start, score: 0.7769607843137255, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:37:21,380 pattern_ranker.py:326:
[INFO]2023-08-20 02:37:34,290 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'currencyservice-cf787dd48-vpjrd', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:37:42,992 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:37:43,795 pattern_ranker.py:198: Soted Result List: [{'events': '104_23', 'score': 1.0, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:37:43,857 pattern_ranker.py:260: 2022-08-22 05:27:06 Inject RCA Result:
[INFO]2023-08-20 02:37:43,858 pattern_ranker.py:262: 2022-08-22 05:27:06 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, network_delay
[INFO]2023-08-20 02:37:43,858 pattern_ranker.py:277: 2022-08-22 05:27:06 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, network_delay score 1
[INFO]2023-08-20 02:37:43,858 pattern_ranker.py:315: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, score: 1.0, deepth: 2, pod currencyservice-cf787dd48-vpjrd, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:37:43,858 pattern_ranker.py:326:
[INFO]2023-08-20 02:38:06,811 data_integrate.py:481: [{'pod': 'emailservice-55fdc5b988-f6xth', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:38:26,561 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:38:26,663 pattern_ranker.py:198: Soted Result List: [{'events': '187_52', 'score': 1.0, 'deepth': 5, 'pod': 'emailservice-55fdc5b988-f6xth', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:38:26,748 pattern_ranker.py:260: 2022-08-22 05:35:34 Inject RCA Result:
[INFO]2023-08-20 02:38:26,748 pattern_ranker.py:262: 2022-08-22 05:35:34 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_contention
[INFO]2023-08-20 02:38:26,748 pattern_ranker.py:277: 2022-08-22 05:35:34 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_contention score 1
[INFO]2023-08-20 02:38:26,748 pattern_ranker.py:315: source :emailservice /hipstershop.EmailService/SendOrderConfirmation start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Send order confirmation email to someone@example.com start., score: 1.0, deepth: 5, pod emailservice-55fdc5b988-f6xth, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:38:26,748 pattern_ranker.py:326:
[INFO]2023-08-20 02:38:49,668 data_integrate.py:481: [{'pod': 'emailservice-55fdc5b988-f6xth', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:39:09,812 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:39:09,920 pattern_ranker.py:198: Soted Result List: [{'events': '187_52', 'score': 1.0, 'deepth': 5, 'pod': 'emailservice-55fdc5b988-f6xth', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:39:10,022 pattern_ranker.py:260: 2022-08-22 05:43:48 Inject RCA Result:
[INFO]2023-08-20 02:39:10,022 pattern_ranker.py:262: 2022-08-22 05:43:48 Inject Ground Truth: emailservice-55fdc5b988-f6xth, network_delay
[INFO]2023-08-20 02:39:10,022 pattern_ranker.py:277: 2022-08-22 05:43:48 Inject Ground Truth: emailservice-55fdc5b988-f6xth, network_delay score 1
[INFO]2023-08-20 02:39:10,022 pattern_ranker.py:315: source :emailservice /hipstershop.EmailService/SendOrderConfirmation start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Send order confirmation email to someone@example.com start., score: 1.0, deepth: 5, pod emailservice-55fdc5b988-f6xth, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:39:10,022 pattern_ranker.py:326:
[INFO]2023-08-20 02:39:33,245 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'paymentservice-9cdb6588f-554sm', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:39:55,486 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:39:55,586 pattern_ranker.py:198: Soted Result List: [{'events': '165_48', 'score': 1.0, 'deepth': 5, 'pod': 'paymentservice-9cdb6588f-554sm', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:39:55,676 pattern_ranker.py:260: 2022-08-22 05:52:54 Inject RCA Result:
[INFO]2023-08-20 02:39:55,676 pattern_ranker.py:262: 2022-08-22 05:52:54 Inject Ground Truth: paymentservice-9cdb6588f-554sm, network_delay
[INFO]2023-08-20 02:39:55,676 pattern_ranker.py:277: 2022-08-22 05:52:54 Inject Ground Truth: paymentservice-9cdb6588f-554sm, network_delay score 1
[INFO]2023-08-20 02:39:55,676 pattern_ranker.py:315: source :paymentservice grpc.hipstershop.PaymentService/Charge start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> PaymentService#Charge invoked with request<:ITEM:>, score: 1.0, deepth: 5, pod paymentservice-9cdb6588f-554sm, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:39:55,676 pattern_ranker.py:326:
[INFO]2023-08-20 02:40:18,507 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'paymentservice-9cdb6588f-554sm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:40:39,070 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:40:39,168 pattern_ranker.py:198: Soted Result List: [{'events': '165_48', 'score': 1.0, 'deepth': 5, 'pod': 'paymentservice-9cdb6588f-554sm', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:40:39,258 pattern_ranker.py:260: 2022-08-22 06:01:18 Inject RCA Result:
[INFO]2023-08-20 02:40:39,258 pattern_ranker.py:262: 2022-08-22 06:01:18 Inject Ground Truth: paymentservice-9cdb6588f-554sm, cpu_contention
[INFO]2023-08-20 02:40:39,258 pattern_ranker.py:277: 2022-08-22 06:01:18 Inject Ground Truth: paymentservice-9cdb6588f-554sm, cpu_contention score 1
[INFO]2023-08-20 02:40:39,258 pattern_ranker.py:315: source :paymentservice grpc.hipstershop.PaymentService/Charge start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> PaymentService#Charge invoked with request<:ITEM:>, score: 1.0, deepth: 5, pod paymentservice-9cdb6588f-554sm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:40:39,258 pattern_ranker.py:326:
[INFO]2023-08-20 02:40:58,766 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'productcatalogservice-668d5f85fb-wckp8', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:41:17,078 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:41:18,424 pattern_ranker.py:198: Soted Result List: [{'events': '90_8', 'score': 1.0, 'deepth': 6, 'pod': 'productcatalogservice-668d5f85fb-wckp8', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:41:18,509 pattern_ranker.py:260: 2022-08-22 06:35:39 Inject RCA Result:
[INFO]2023-08-20 02:41:18,509 pattern_ranker.py:262: 2022-08-22 06:35:39 Inject Ground Truth: productcatalogservice-668d5f85fb-wckp8, cpu_consumed
[INFO]2023-08-20 02:41:18,509 pattern_ranker.py:277: 2022-08-22 06:35:39 Inject Ground Truth: productcatalogservice-668d5f85fb-wckp8, cpu_consumed score 1
[INFO]2023-08-20 02:41:18,510 pattern_ranker.py:315: source :productcatalogservice hipstershop.ProductCatalogService/GetProduct start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, score: 1.0, deepth: 6, pod productcatalogservice-668d5f85fb-wckp8, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:41:18,510 pattern_ranker.py:326:
[INFO]2023-08-20 02:41:37,798 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:41:55,914 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:41:56,107 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:41:56,190 pattern_ranker.py:260: 2022-08-22 06:52:56 Inject RCA Result:
[INFO]2023-08-20 02:41:56,191 pattern_ranker.py:262: 2022-08-22 06:52:56 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, network_delay
[INFO]2023-08-20 02:41:56,191 pattern_ranker.py:277: 2022-08-22 06:52:56 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, network_delay score 1
[INFO]2023-08-20 02:41:56,191 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:41:56,191 pattern_ranker.py:326:
[INFO]2023-08-20 02:42:14,904 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:42:32,029 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:42:32,230 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:42:32,314 pattern_ranker.py:260: 2022-08-22 07:01:25 Inject RCA Result:
[INFO]2023-08-20 02:42:32,314 pattern_ranker.py:262: 2022-08-22 07:01:25 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_contention
[INFO]2023-08-20 02:42:32,315 pattern_ranker.py:277: 2022-08-22 07:01:25 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_contention score 1
[INFO]2023-08-20 02:42:32,315 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:42:32,315 pattern_ranker.py:326:
[INFO]2023-08-20 02:42:43,684 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:42:51,174 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:42:52,460 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'CpuUsageRate(%)'}, {'events': '104_106', 'score': 0.7067988668555241, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '28_208', 'score': 0.6753246753246753, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '4_42', 'score': 0.6753246753246753, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_41', 'score': 0.6753246753246753, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_40', 'score': 0.6744186046511628, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:42:52,513 pattern_ranker.py:260: 2022-08-22 07:10:43 Inject RCA Result:
[INFO]2023-08-20 02:42:52,513 pattern_ranker.py:262: 2022-08-22 07:10:43 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_consumed
[INFO]2023-08-20 02:42:52,513 pattern_ranker.py:277: 2022-08-22 07:10:43 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_consumed score 1
[INFO]2023-08-20 02:42:52,513 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:42:52,513 pattern_ranker.py:318: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: currencyservice hipstershop.CurrencyService/Carry start, score: 0.7067988668555241, deepth: 2, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:42:52,514 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 0.6753246753246753, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:42:52,514 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home started, score: 0.6753246753246753, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:42:52,514 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 0.6753246753246753, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:42:52,514 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Setting currency started, score: 0.6744186046511628, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:42:52,514 pattern_ranker.py:326:
[INFO]2023-08-20 02:43:14,301 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'shippingservice-7b598fc7d-lmggd', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:43:33,294 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:43:33,957 pattern_ranker.py:198: Soted Result List: [{'events': '130_34', 'score': 1.0, 'deepth': 8, 'pod': 'shippingservice-7b598fc7d-lmggd', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:43:34,048 pattern_ranker.py:260: 2022-08-22 07:17:55 Inject RCA Result:
[INFO]2023-08-20 02:43:34,049 pattern_ranker.py:262: 2022-08-22 07:17:55 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, network_delay
[INFO]2023-08-20 02:43:34,049 pattern_ranker.py:277: 2022-08-22 07:17:55 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, network_delay score 1
[INFO]2023-08-20 02:43:34,049 pattern_ranker.py:315: source :shippingservice hipstershop.ShippingService/QuoteByCountFloat start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:>[QuoteByCountFloat] received request, score: 1.0, deepth: 8, pod shippingservice-7b598fc7d-lmggd, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:43:34,049 pattern_ranker.py:326:
[INFO]2023-08-20 02:43:55,931 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'shippingservice-7b598fc7d-lmggd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:44:15,964 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:44:16,618 pattern_ranker.py:198: Soted Result List: [{'events': '130_34', 'score': 1.0, 'deepth': 8, 'pod': 'shippingservice-7b598fc7d-lmggd', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:44:16,711 pattern_ranker.py:260: 2022-08-22 07:26:48 Inject RCA Result:
[INFO]2023-08-20 02:44:16,712 pattern_ranker.py:262: 2022-08-22 07:26:48 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_contention
[INFO]2023-08-20 02:44:16,712 pattern_ranker.py:277: 2022-08-22 07:26:48 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_contention score 1
[INFO]2023-08-20 02:44:16,712 pattern_ranker.py:315: source :shippingservice hipstershop.ShippingService/QuoteByCountFloat start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:>[QuoteByCountFloat] received request, score: 1.0, deepth: 8, pod shippingservice-7b598fc7d-lmggd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:44:16,712 pattern_ranker.py:326:
[INFO]2023-08-20 02:44:39,738 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:45:01,610 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:45:02,432 pattern_ranker.py:198: Soted Result List: [{'events': '28_208', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '16_41', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:45:02,531 pattern_ranker.py:260: 2022-08-22 07:44:20 Inject RCA Result:
[INFO]2023-08-20 02:45:02,532 pattern_ranker.py:262: 2022-08-22 07:44:20 Inject Ground Truth: adservice-5f6585d649-fnmft, return
[INFO]2023-08-20 02:45:02,532 pattern_ranker.py:293: 2022-08-22 07:44:20 Inject Ground Truth: adservice-5f6585d649-fnmft, return score 1
[INFO]2023-08-20 02:45:02,532 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:45:02,532 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:45:02,532 pattern_ranker.py:326:
[INFO]2023-08-20 02:45:23,677 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:45:44,475 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:45:45,287 pattern_ranker.py:198: Soted Result List: [{'events': '28_208', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '16_41', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:45:45,382 pattern_ranker.py:260: 2022-08-22 07:53:33 Inject RCA Result:
[INFO]2023-08-20 02:45:45,382 pattern_ranker.py:262: 2022-08-22 07:53:33 Inject Ground Truth: adservice-5f6585d649-fnmft, exception
[INFO]2023-08-20 02:45:45,382 pattern_ranker.py:293: 2022-08-22 07:53:33 Inject Ground Truth: adservice-5f6585d649-fnmft, exception score 1
[INFO]2023-08-20 02:45:45,382 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:45:45,383 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:45:45,383 pattern_ranker.py:326:
[INFO]2023-08-20 02:46:07,616 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:46:27,581 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:46:43,311 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:46:54,957 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:46:55,261 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.7368421052631579, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:260: 2022-08-23 12:01:25 Inject RCA Result:
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:262: 2022-08-23 12:01:25 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:277: 2022-08-23 12:01:25 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention score 1
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:315: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7368421052631579, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:46:55,330 pattern_ranker.py:326:
[INFO]2023-08-20 02:47:06,845 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:47:20,955 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:47:23,224 pattern_ranker.py:198: Soted Result List: [{'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_119', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_120', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '18_78', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_17', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_80', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_82', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_86', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:47:23,310 pattern_ranker.py:260: 2022-08-23 12:10:21 Inject RCA Result:
[INFO]2023-08-20 02:47:23,311 pattern_ranker.py:262: 2022-08-23 12:10:21 Inject Ground Truth: frontend-579b9bff58-t2dbm, return
[INFO]2023-08-20 02:47:23,311 pattern_ranker.py:293: 2022-08-23 12:10:21 Inject Ground Truth: frontend-579b9bff58-t2dbm, return score 2
[INFO]2023-08-20 02:47:23,311 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:47:23,311 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdServiceImpl/getAds end, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdService/<:SPANID:> start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.ProductCatalogService/GetProduct start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,312 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/GetSupportedCurrencies start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CartService/GetCart start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,313 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.RecommendationService/ListRecommendations start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,314 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Product id not specified
[INFO]2023-08-20 02:47:23,314 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:47:23,314 pattern_ranker.py:326:
[INFO]2023-08-20 02:47:41,069 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:47:57,126 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:47:57,426 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:260: 2022-08-23 12:18:23 Inject RCA Result:
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:262: 2022-08-23 12:18:23 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:277: 2022-08-23 12:18:23 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed score 1
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:315: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:47:57,517 pattern_ranker.py:326:
[INFO]2023-08-20 02:48:19,375 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:48:39,887 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:48:39,965 pattern_ranker.py:198: Soted Result List: [{'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:48:40,061 pattern_ranker.py:260: 2022-08-23 12:27:23 Inject RCA Result:
[INFO]2023-08-20 02:48:40,061 pattern_ranker.py:262: 2022-08-23 12:27:23 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception
[INFO]2023-08-20 02:48:40,062 pattern_ranker.py:293: 2022-08-23 12:27:23 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception score 1
[INFO]2023-08-20 02:48:40,062 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:48:40,062 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:48:40,062 pattern_ranker.py:326:
[INFO]2023-08-20 02:49:01,305 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:49:20,527 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:49:21,314 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'NetworkP90(ms)'}, {'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '23_100', 'score': 0.6744186046511628, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:49:21,420 pattern_ranker.py:260: 2022-08-23 12:35:57 Inject RCA Result:
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:262: 2022-08-23 12:35:57 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:277: 2022-08-23 12:35:57 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay score 1
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:315: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.6744186046511628, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:49:21,421 pattern_ranker.py:326:
[INFO]2023-08-20 02:49:43,460 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:50:02,780 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:50:03,336 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:50:03,434 pattern_ranker.py:260: 2022-08-23 12:45:08 Inject RCA Result:
[INFO]2023-08-20 02:50:03,434 pattern_ranker.py:262: 2022-08-23 12:45:08 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention
[INFO]2023-08-20 02:50:03,434 pattern_ranker.py:277: 2022-08-23 12:45:08 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention score 1
[INFO]2023-08-20 02:50:03,434 pattern_ranker.py:315: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:50:03,435 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:50:03,435 pattern_ranker.py:326:
[INFO]2023-08-20 02:50:25,767 data_integrate.py:481: [{'pod': 'checkoutservice-578fcf4766-9csqn', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:50:47,307 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:50:47,944 pattern_ranker.py:198: Soted Result List: [{'events': '158_65', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn', 'resource': 'NetworkP90(ms)'}, {'events': '23_100', 'score': 0.7073170731707317, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:50:48,056 pattern_ranker.py:260: 2022-08-23 12:53:52 Inject RCA Result:
[INFO]2023-08-20 02:50:48,057 pattern_ranker.py:262: 2022-08-23 12:53:52 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, network_delay
[INFO]2023-08-20 02:50:48,057 pattern_ranker.py:277: 2022-08-23 12:53:52 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, network_delay score 1
[INFO]2023-08-20 02:50:48,057 pattern_ranker.py:315: source :checkoutservice hipstershop.CheckoutService/ConvertCurrency start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Start convert currency from currency code:<:ITEM:>, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:50:48,057 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7073170731707317, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:50:48,057 pattern_ranker.py:326:
[INFO]2023-08-20 02:51:11,437 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:51:31,608 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:51:32,057 pattern_ranker.py:198: Soted Result List: [{'events': '62_61', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '62_150', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_60', 'score': 1.0, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '23_100', 'score': 0.6904761904761905, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:51:32,156 pattern_ranker.py:260: 2022-08-23 13:02:09 Inject RCA Result:
[INFO]2023-08-20 02:51:32,156 pattern_ranker.py:262: 2022-08-23 13:02:09 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, exception
[INFO]2023-08-20 02:51:32,156 pattern_ranker.py:293: 2022-08-23 13:02:09 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, exception score 1
[INFO]2023-08-20 02:51:32,157 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Charge successfully, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:51:32,157 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to connect payment service: connect error.
[INFO]2023-08-20 02:51:32,157 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: checkoutservice hipstershop.PaymentService/Charge start, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:51:32,157 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to connect payment service: connect error.
[INFO]2023-08-20 02:51:32,157 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Payment went through (transaction id: <:*:>, score: 1.0, deepth: 3, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:51:32,158 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: checkoutservice hipstershop.CheckoutService/PlaceOrder end
[INFO]2023-08-20 02:51:32,158 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:51:32,158 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:51:32,158 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.6904761904761905, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:51:32,158 pattern_ranker.py:326:
[INFO]2023-08-20 02:51:55,416 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:52:15,344 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:52:15,511 pattern_ranker.py:198: Soted Result List: [{'events': '62_61', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_60', 'score': 1.0, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 02:52:15,615 pattern_ranker.py:260: 2022-08-23 13:10:36 Inject RCA Result:
[INFO]2023-08-20 02:52:15,615 pattern_ranker.py:262: 2022-08-23 13:10:36 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, return
[INFO]2023-08-20 02:52:15,615 pattern_ranker.py:293: 2022-08-23 13:10:36 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, return score 1
[INFO]2023-08-20 02:52:15,615 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Charge successfully, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start charge card, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not charge the card: charge card error.
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Payment went through (transaction id: <:*:>, score: 1.0, deepth: 3, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Get OrderID <:USERID:>, target: checkoutservice hipstershop.CheckoutService/PlaceOrder end
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to complete the order
[INFO]2023-08-20 02:52:15,616 pattern_ranker.py:326:
[INFO]2023-08-20 02:52:37,888 data_integrate.py:481: [{'pod': 'checkoutservice-578fcf4766-9csqn', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:52:57,931 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:52:58,320 pattern_ranker.py:198: Soted Result List: [{'events': '158_65', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:52:58,409 pattern_ranker.py:260: 2022-08-23 13:19:06 Inject RCA Result:
[INFO]2023-08-20 02:52:58,409 pattern_ranker.py:262: 2022-08-23 13:19:06 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_consumed
[INFO]2023-08-20 02:52:58,409 pattern_ranker.py:277: 2022-08-23 13:19:06 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_consumed score 1
[INFO]2023-08-20 02:52:58,409 pattern_ranker.py:315: source :checkoutservice hipstershop.CheckoutService/ConvertCurrency start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Start convert currency from currency code:<:ITEM:>, score: 1.0, deepth: 4, pod checkoutservice-578fcf4766-9csqn, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:52:58,409 pattern_ranker.py:326:
[INFO]2023-08-20 02:53:04,153 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'currencyservice-cf787dd48-vpjrd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:53:08,324 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:53:11,271 pattern_ranker.py:198: Soted Result List: [{'events': '104_23', 'score': 1.0, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd', 'resource': 'CpuUsageRate(%)'}, {'events': '69_146', 'score': 0.8363636363636363, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '69_158', 'score': 0.8363636363636363, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '4_40', 'score': 0.8043478260869565, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_38', 'score': 0.7890625, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_18', 'score': 0.7864077669902912, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 0.7864077669902912, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_3', 'score': 0.7833333333333333, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_50', 'score': 0.782608695652174, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '76_4', 'score': 0.778816199376947, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '120_198', 'score': 0.7786069651741293, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}]
[INFO]2023-08-20 02:53:11,301 pattern_ranker.py:260: 2022-08-23 13:27:51 Inject RCA Result:
[INFO]2023-08-20 02:53:11,301 pattern_ranker.py:262: 2022-08-23 13:27:51 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, cpu_contention
[INFO]2023-08-20 02:53:11,301 pattern_ranker.py:277: 2022-08-23 13:27:51 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, cpu_contention score 1
[INFO]2023-08-20 02:53:11,301 pattern_ranker.py:315: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, score: 1.0, deepth: 2, pod currencyservice-cf787dd48-vpjrd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:53:11,301 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.ProductCatalogService/GetProduct start, score: 0.8363636363636363, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.CheckoutService/ConvertCurrency start, score: 0.8363636363636363, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Setting currency started, score: 0.8043478260869565, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, score: 0.7890625, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, score: 0.7864077669902912, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page complete, score: 0.7864077669902912, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Adding to cart started, score: 0.7833333333333333, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, score: 0.782608695652174, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:318: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 0.778816199376947, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:53:11,302 pattern_ranker.py:326:
[INFO]2023-08-20 02:53:25,099 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'currencyservice-cf787dd48-vpjrd', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:53:34,882 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:53:35,709 pattern_ranker.py:198: Soted Result List: [{'events': '104_23', 'score': 1.0, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:53:35,778 pattern_ranker.py:260: 2022-08-23 13:37:08 Inject RCA Result:
[INFO]2023-08-20 02:53:35,778 pattern_ranker.py:262: 2022-08-23 13:37:08 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, network_delay
[INFO]2023-08-20 02:53:35,778 pattern_ranker.py:277: 2022-08-23 13:37:08 Inject Ground Truth: currencyservice-cf787dd48-vpjrd, network_delay score 1
[INFO]2023-08-20 02:53:35,778 pattern_ranker.py:315: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, score: 1.0, deepth: 2, pod currencyservice-cf787dd48-vpjrd, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:53:35,778 pattern_ranker.py:326:
[INFO]2023-08-20 02:53:58,792 data_integrate.py:481: [{'pod': 'emailservice-55fdc5b988-f6xth', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:54:19,161 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:54:19,725 pattern_ranker.py:198: Soted Result List: [{'events': '187_52', 'score': 1.0, 'deepth': 5, 'pod': 'emailservice-55fdc5b988-f6xth', 'resource': 'CpuUsageRate(%)'}, {'events': '23_100', 'score': 0.725, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:54:19,826 pattern_ranker.py:260: 2022-08-23 13:45:53 Inject RCA Result:
[INFO]2023-08-20 02:54:19,826 pattern_ranker.py:262: 2022-08-23 13:45:53 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_contention
[INFO]2023-08-20 02:54:19,826 pattern_ranker.py:277: 2022-08-23 13:45:53 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_contention score 1
[INFO]2023-08-20 02:54:19,826 pattern_ranker.py:315: source :emailservice /hipstershop.EmailService/SendOrderConfirmation start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Send order confirmation email to someone@example.com start., score: 1.0, deepth: 5, pod emailservice-55fdc5b988-f6xth, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:54:19,827 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.725, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:54:19,827 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:54:19,827 pattern_ranker.py:326:
[INFO]2023-08-20 02:54:43,345 data_integrate.py:481: [{'pod': 'emailservice-55fdc5b988-f6xth', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:55:04,900 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:55:05,235 pattern_ranker.py:198: Soted Result List: [{'events': '187_52', 'score': 1.0, 'deepth': 5, 'pod': 'emailservice-55fdc5b988-f6xth', 'resource': 'NetworkP90(ms)'}, {'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:55:05,348 pattern_ranker.py:260: 2022-08-23 13:54:37 Inject RCA Result:
[INFO]2023-08-20 02:55:05,349 pattern_ranker.py:262: 2022-08-23 13:54:37 Inject Ground Truth: emailservice-55fdc5b988-f6xth, network_delay
[INFO]2023-08-20 02:55:05,349 pattern_ranker.py:277: 2022-08-23 13:54:37 Inject Ground Truth: emailservice-55fdc5b988-f6xth, network_delay score 1
[INFO]2023-08-20 02:55:05,349 pattern_ranker.py:315: source :emailservice /hipstershop.EmailService/SendOrderConfirmation start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Send order confirmation email to someone@example.com start., score: 1.0, deepth: 5, pod emailservice-55fdc5b988-f6xth, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:55:05,349 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:55:05,349 pattern_ranker.py:326:
[INFO]2023-08-20 02:55:29,801 data_integrate.py:481: [{'pod': 'emailservice-55fdc5b988-f6xth', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:55:54,854 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:55:54,965 pattern_ranker.py:198: Soted Result List: [{'events': '187_52', 'score': 1.0, 'deepth': 5, 'pod': 'emailservice-55fdc5b988-f6xth', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:55:55,062 pattern_ranker.py:260: 2022-08-23 14:03:48 Inject RCA Result:
[INFO]2023-08-20 02:55:55,062 pattern_ranker.py:262: 2022-08-23 14:03:48 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_consumed
[INFO]2023-08-20 02:55:55,062 pattern_ranker.py:277: 2022-08-23 14:03:48 Inject Ground Truth: emailservice-55fdc5b988-f6xth, cpu_consumed score 1
[INFO]2023-08-20 02:55:55,063 pattern_ranker.py:315: source :emailservice /hipstershop.EmailService/SendOrderConfirmation start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Send order confirmation email to someone@example.com start., score: 1.0, deepth: 5, pod emailservice-55fdc5b988-f6xth, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:55:55,063 pattern_ranker.py:326:
[INFO]2023-08-20 02:56:16,209 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'paymentservice-9cdb6588f-554sm', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:56:36,193 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:56:36,515 pattern_ranker.py:198: Soted Result List: [{'events': '165_48', 'score': 1.0, 'deepth': 5, 'pod': 'paymentservice-9cdb6588f-554sm', 'resource': 'NetworkP90(ms)'}, {'events': '23_100', 'score': 0.725, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:56:36,609 pattern_ranker.py:260: 2022-08-23 14:12:52 Inject RCA Result:
[INFO]2023-08-20 02:56:36,609 pattern_ranker.py:262: 2022-08-23 14:12:52 Inject Ground Truth: paymentservice-9cdb6588f-554sm, network_delay
[INFO]2023-08-20 02:56:36,610 pattern_ranker.py:277: 2022-08-23 14:12:52 Inject Ground Truth: paymentservice-9cdb6588f-554sm, network_delay score 1
[INFO]2023-08-20 02:56:36,610 pattern_ranker.py:315: source :paymentservice grpc.hipstershop.PaymentService/Charge start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> PaymentService#Charge invoked with request<:ITEM:>, score: 1.0, deepth: 5, pod paymentservice-9cdb6588f-554sm, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:56:36,610 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.725, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:56:36,610 pattern_ranker.py:326:
[INFO]2023-08-20 02:56:59,243 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'paymentservice-9cdb6588f-554sm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:57:20,071 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:57:20,400 pattern_ranker.py:198: Soted Result List: [{'events': '165_48', 'score': 1.0, 'deepth': 5, 'pod': 'paymentservice-9cdb6588f-554sm', 'resource': 'CpuUsageRate(%)'}, {'events': '23_100', 'score': 0.6744186046511628, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:57:20,503 pattern_ranker.py:260: 2022-08-23 14:21:54 Inject RCA Result:
[INFO]2023-08-20 02:57:20,503 pattern_ranker.py:262: 2022-08-23 14:21:54 Inject Ground Truth: paymentservice-9cdb6588f-554sm, cpu_contention
[INFO]2023-08-20 02:57:20,504 pattern_ranker.py:277: 2022-08-23 14:21:54 Inject Ground Truth: paymentservice-9cdb6588f-554sm, cpu_contention score 1
[INFO]2023-08-20 02:57:20,504 pattern_ranker.py:315: source :paymentservice grpc.hipstershop.PaymentService/Charge start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> PaymentService#Charge invoked with request<:ITEM:>, score: 1.0, deepth: 5, pod paymentservice-9cdb6588f-554sm, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:57:20,504 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.6744186046511628, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:57:20,504 pattern_ranker.py:326:
[INFO]2023-08-20 02:57:40,203 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:57:58,803 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:57:59,078 pattern_ranker.py:198: Soted Result List: [{'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:57:59,161 pattern_ranker.py:260: 2022-08-23 14:30:10 Inject RCA Result:
[INFO]2023-08-20 02:57:59,161 pattern_ranker.py:262: 2022-08-23 14:30:10 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, network_delay
[INFO]2023-08-20 02:57:59,162 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:57:59,162 pattern_ranker.py:326:
[INFO]2023-08-20 02:58:05,004 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:58:14,934 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:58:17,929 pattern_ranker.py:198: Soted Result List: [{'events': '8_214', 'score': 1.0, 'deepth': 7, 'pod': 'productcatalogservice-668d5f85fb-jhwx9'}, {'events': '69_158', 'score': 1.0, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_120', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '24_100', 'score': 1.0, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '38_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_17', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_80', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_82', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_86', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_37', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_124', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '3_2', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '3_167', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_78', 'score': 0.9027595269382391, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '49_78', 'score': 0.8653846153846154, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_78', 'score': 0.8551319648093841, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '23_100', 'score': 0.8529411764705882, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '23_106', 'score': 0.694478527607362, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:58:18,006 pattern_ranker.py:260: 2022-08-23 14:47:40 Inject RCA Result:
[INFO]2023-08-20 02:58:18,006 pattern_ranker.py:262: 2022-08-23 14:47:40 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, return
[INFO]2023-08-20 02:58:18,007 pattern_ranker.py:293: 2022-08-23 14:47:40 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, return score 1
[INFO]2023-08-20 02:58:18,007 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product successfully, score: 1.0, deepth: 7, pod productcatalogservice-668d5f85fb-jhwx9
[INFO]2023-08-20 02:58:18,007 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> No product with ID <:PRODUCTID:>
[INFO]2023-08-20 02:58:18,007 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.CheckoutService/ConvertCurrency start, score: 1.0, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:58:18,008 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to get product #"<:PRODUCTID:>"
[INFO]2023-08-20 02:58:18,008 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:58:18,008 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdService/<:SPANID:> start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:58:18,008 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 1.0, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 02:58:18,008 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to get product recommendations
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/GetSupportedCurrencies start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CartService/GetCart start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:58:18,009 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:58:18,010 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:58:18,010 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:58:18,010 pattern_ranker.py:326:
[INFO]2023-08-20 02:58:36,222 data_integrate.py:481: [{'pod': 'productcatalogservice-668d5f85fb-jhwx9', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:58:52,893 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:58:54,244 pattern_ranker.py:198: Soted Result List: [{'events': '90_8', 'score': 1.0, 'deepth': 6, 'pod': 'productcatalogservice-668d5f85fb-jhwx9', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 02:58:54,334 pattern_ranker.py:260: 2022-08-23 14:55:55 Inject RCA Result:
[INFO]2023-08-20 02:58:54,334 pattern_ranker.py:262: 2022-08-23 14:55:55 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, cpu_consumed
[INFO]2023-08-20 02:58:54,334 pattern_ranker.py:277: 2022-08-23 14:55:55 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, cpu_consumed score 1
[INFO]2023-08-20 02:58:54,334 pattern_ranker.py:315: source :productcatalogservice hipstershop.ProductCatalogService/GetProduct start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, score: 1.0, deepth: 6, pod productcatalogservice-668d5f85fb-jhwx9, resource alert CpuUsageRate(%)
[INFO]2023-08-20 02:58:54,334 pattern_ranker.py:326:
[INFO]2023-08-20 02:58:59,839 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:59:09,252 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:59:12,490 pattern_ranker.py:198: Soted Result List: [{'events': '8_214', 'score': 1.0, 'deepth': 7, 'pod': 'productcatalogservice-668d5f85fb-jhwx9'}, {'events': '69_158', 'score': 1.0, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_120', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '38_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_17', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_80', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_82', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_86', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_37', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_124', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '3_2', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '3_167', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '49_78', 'score': 0.9574468085106383, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '38_78', 'score': 0.9123505976095617, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '24_100', 'score': 0.875, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '23_100', 'score': 0.8529411764705882, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '18_78', 'score': 0.8476744186046512, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '69_68', 'score': 0.8181818181818182, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '72_63', 'score': 0.8181818181818182, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '72_160', 'score': 0.8181818181818182, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '72_158', 'score': 0.8181818181818182, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_60', 'score': 0.8181818181818182, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '73_162', 'score': 0.8181818181818182, 'deepth': 3, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '50_49', 'score': 0.8181818181818182, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '23_106', 'score': 0.6767636508569151, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 02:59:12,566 pattern_ranker.py:260: 2022-08-23 15:04:28 Inject RCA Result:
[INFO]2023-08-20 02:59:12,566 pattern_ranker.py:262: 2022-08-23 15:04:28 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, exception
[INFO]2023-08-20 02:59:12,567 pattern_ranker.py:293: 2022-08-23 15:04:28 Inject Ground Truth: productcatalogservice-668d5f85fb-jhwx9, exception score 1
[INFO]2023-08-20 02:59:12,567 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product successfully, score: 1.0, deepth: 7, pod productcatalogservice-668d5f85fb-jhwx9
[INFO]2023-08-20 02:59:12,567 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Query product with name and description <:*:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> failed to scan mysql query result: Query product error.
[INFO]2023-08-20 02:59:12,567 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.CheckoutService/ConvertCurrency start, score: 1.0, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to get product #"<:PRODUCTID:>"
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdService/<:SPANID:> start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> View user cart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to get product recommendations
[INFO]2023-08-20 02:59:12,568 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,569 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:59:12,569 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/GetSupportedCurrencies start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,569 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:59:12,569 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CartService/GetCart start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,569 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:59:12,570 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,570 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:59:12,570 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.RecommendationService/ListRecommendations start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 02:59:12,570 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Could not retrieve product
[INFO]2023-08-20 02:59:12,570 pattern_ranker.py:326:
[INFO]2023-08-20 02:59:32,875 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 02:59:52,301 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 02:59:52,491 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'NetworkP90(ms)'}]
[INFO]2023-08-20 02:59:52,574 pattern_ranker.py:260: 2022-08-23 15:12:49 Inject RCA Result:
[INFO]2023-08-20 02:59:52,574 pattern_ranker.py:262: 2022-08-23 15:12:49 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, network_delay
[INFO]2023-08-20 02:59:52,574 pattern_ranker.py:277: 2022-08-23 15:12:49 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, network_delay score 1
[INFO]2023-08-20 02:59:52,574 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert NetworkP90(ms)
[INFO]2023-08-20 02:59:52,574 pattern_ranker.py:326:
[INFO]2023-08-20 03:00:09,845 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:00:25,504 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:00:25,927 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.7368421052631579, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 03:00:26,000 pattern_ranker.py:260: 2022-08-23 15:21:41 Inject RCA Result:
[INFO]2023-08-20 03:00:26,000 pattern_ranker.py:262: 2022-08-23 15:21:41 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_contention
[INFO]2023-08-20 03:00:26,001 pattern_ranker.py:277: 2022-08-23 15:21:41 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_contention score 1
[INFO]2023-08-20 03:00:26,001 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:00:26,001 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7368421052631579, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:00:26,001 pattern_ranker.py:326:
[INFO]2023-08-20 03:00:37,351 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'recommendationservice-6cfdd55578-gfj6q', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:00:44,980 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:00:46,728 pattern_ranker.py:198: Soted Result List: [{'events': '108_7', 'score': 1.0, 'deepth': 2, 'pod': 'recommendationservice-6cfdd55578-gfj6q', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.7777777777777778, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '69_146', 'score': 0.7666666666666667, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '69_158', 'score': 0.7666666666666667, 'deepth': 5, 'pod': 'checkoutservice-578fcf4766-9csqn'}, {'events': '4_50', 'score': 0.6923076923076923, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '28_208', 'score': 0.675, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '4_42', 'score': 0.675, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_41', 'score': 0.675, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '4_18', 'score': 0.6712707182320442, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 03:00:46,790 pattern_ranker.py:260: 2022-08-23 15:29:49 Inject RCA Result:
[INFO]2023-08-20 03:00:46,790 pattern_ranker.py:262: 2022-08-23 15:29:49 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_consumed
[INFO]2023-08-20 03:00:46,790 pattern_ranker.py:277: 2022-08-23 15:29:49 Inject Ground Truth: recommendationservice-6cfdd55578-gfj6q, cpu_consumed score 1
[INFO]2023-08-20 03:00:46,790 pattern_ranker.py:315: source :recommendationservice /hipstershop.RecommendationService/ListRecommendations start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Query Recommendations, score: 1.0, deepth: 2, pod recommendationservice-6cfdd55578-gfj6q, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7777777777777778, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.ProductCatalogService/GetProduct start, score: 0.7666666666666667, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Start query cost of products<:ITEM:>, target: checkoutservice hipstershop.CheckoutService/ConvertCurrency start, score: 0.7666666666666667, deepth: 5, pod checkoutservice-578fcf4766-9csqn
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, score: 0.6923076923076923, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 0.675, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 03:00:46,791 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home started, score: 0.675, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:00:46,792 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 0.675, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:00:46,792 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, score: 0.6712707182320442, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:00:46,792 pattern_ranker.py:326:
[INFO]2023-08-20 03:01:09,134 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'shippingservice-7b598fc7d-lmggd', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:01:30,386 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:01:31,246 pattern_ranker.py:198: Soted Result List: [{'events': '130_34', 'score': 1.0, 'deepth': 8, 'pod': 'shippingservice-7b598fc7d-lmggd', 'resource': 'NetworkP90(ms)'}, {'events': '24_100', 'score': 0.8235294117647058, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:260: 2022-08-23 15:38:52 Inject RCA Result:
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:262: 2022-08-23 15:38:52 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, network_delay
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:277: 2022-08-23 15:38:52 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, network_delay score 1
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:315: source :shippingservice hipstershop.ShippingService/QuoteByCountFloat start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:>[QuoteByCountFloat] received request, score: 1.0, deepth: 8, pod shippingservice-7b598fc7d-lmggd, resource alert NetworkP90(ms)
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.8235294117647058, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:01:31,339 pattern_ranker.py:326:
[INFO]2023-08-20 03:01:53,601 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'shippingservice-7b598fc7d-lmggd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:02:15,118 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:02:15,741 pattern_ranker.py:198: Soted Result List: [{'events': '130_34', 'score': 1.0, 'deepth': 8, 'pod': 'shippingservice-7b598fc7d-lmggd', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 03:02:15,825 pattern_ranker.py:260: 2022-08-23 15:47:43 Inject RCA Result:
[INFO]2023-08-20 03:02:15,825 pattern_ranker.py:262: 2022-08-23 15:47:43 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_contention
[INFO]2023-08-20 03:02:15,825 pattern_ranker.py:277: 2022-08-23 15:47:43 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_contention score 1
[INFO]2023-08-20 03:02:15,826 pattern_ranker.py:315: source :shippingservice hipstershop.ShippingService/QuoteByCountFloat start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:>[QuoteByCountFloat] received request, score: 1.0, deepth: 8, pod shippingservice-7b598fc7d-lmggd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:02:15,826 pattern_ranker.py:326:
[INFO]2023-08-20 03:02:38,089 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'shippingservice-7b598fc7d-lmggd', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:02:57,550 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:02:58,178 pattern_ranker.py:198: Soted Result List: [{'events': '130_34', 'score': 1.0, 'deepth': 8, 'pod': 'shippingservice-7b598fc7d-lmggd', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 03:02:58,282 pattern_ranker.py:260: 2022-08-23 15:56:24 Inject RCA Result:
[INFO]2023-08-20 03:02:58,282 pattern_ranker.py:262: 2022-08-23 15:56:24 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_consumed
[INFO]2023-08-20 03:02:58,282 pattern_ranker.py:277: 2022-08-23 15:56:24 Inject Ground Truth: shippingservice-7b598fc7d-lmggd, cpu_consumed score 1
[INFO]2023-08-20 03:02:58,282 pattern_ranker.py:315: source :shippingservice hipstershop.ShippingService/QuoteByCountFloat start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:>[QuoteByCountFloat] received request, score: 1.0, deepth: 8, pod shippingservice-7b598fc7d-lmggd, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:02:58,282 pattern_ranker.py:326:
[INFO]2023-08-20 03:03:18,244 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:03:37,108 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:03:37,609 pattern_ranker.py:198: Soted Result List: [{'events': '24_100', 'score': 0.7, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '23_100', 'score': 0.6744186046511628, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 03:03:37,699 pattern_ranker.py:260: 2022-08-23 16:05:02 Inject RCA Result:
[INFO]2023-08-20 03:03:37,699 pattern_ranker.py:262: 2022-08-23 16:05:02 Inject Ground Truth: adservice-5f6585d649-fnmft, network_delay
[INFO]2023-08-20 03:03:37,699 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.7, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:03:37,700 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.6744186046511628, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:03:37,700 pattern_ranker.py:326:
[INFO]2023-08-20 03:03:59,908 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:04:20,056 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:04:20,884 pattern_ranker.py:198: Soted Result List: [{'events': '28_208', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '16_41', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 03:04:20,989 pattern_ranker.py:260: 2022-08-23 16:13:38 Inject RCA Result:
[INFO]2023-08-20 03:04:20,989 pattern_ranker.py:262: 2022-08-23 16:13:38 Inject Ground Truth: adservice-5f6585d649-fnmft, return
[INFO]2023-08-20 03:04:20,990 pattern_ranker.py:293: 2022-08-23 16:13:38 Inject Ground Truth: adservice-5f6585d649-fnmft, return score 1
[INFO]2023-08-20 03:04:20,990 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 03:04:20,990 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:04:20,990 pattern_ranker.py:326:
[INFO]2023-08-20 03:04:44,226 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:05:05,537 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:05:06,388 pattern_ranker.py:198: Soted Result List: [{'events': '28_208', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '16_41', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:260: 2022-08-23 16:22:53 Inject RCA Result:
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:262: 2022-08-23 16:22:53 Inject Ground Truth: adservice-5f6585d649-fnmft, exception
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:293: 2022-08-23 16:22:53 Inject Ground Truth: adservice-5f6585d649-fnmft, exception score 1
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:315: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: <:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> No context provided. Constructe random Ads start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert MemoryUsageRate(%)
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:05:06,483 pattern_ranker.py:326:
[INFO]2023-08-20 03:05:24,293 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:05:41,055 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:05:42,239 pattern_ranker.py:198: Soted Result List: [{'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.8235294117647058, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}, {'events': '16_41', 'score': 0.8059701492537313, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '17_16', 'score': 0.6988235294117647, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '23_100', 'score': 0.6904761904761905, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 03:05:42,329 pattern_ranker.py:260: 2022-08-23 16:31:35 Inject RCA Result:
[INFO]2023-08-20 03:05:42,329 pattern_ranker.py:262: 2022-08-23 16:31:35 Inject Ground Truth: adservice-5f6585d649-fnmft, cpu_contention
[INFO]2023-08-20 03:05:42,329 pattern_ranker.py:277: 2022-08-23 16:31:35 Inject Ground Truth: adservice-5f6585d649-fnmft, cpu_contention score 1
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.8235294117647058, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request home complete, score: 0.8059701492537313, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, score: 0.6988235294117647, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:323: actual pattern source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Failed to retrieve ads
[INFO]2023-08-20 03:05:42,330 pattern_ranker.py:318: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Received conversion request, target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.6904761904761905, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 03:05:42,331 pattern_ranker.py:326:
[INFO]2023-08-20 03:06:05,268 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 03:06:25,718 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 03:06:26,307 pattern_ranker.py:198: Soted Result List: [{'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:260: 2022-08-23 16:40:57 Inject RCA Result:
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:262: 2022-08-23 16:40:57 Inject Ground Truth: adservice-5f6585d649-fnmft, cpu_consumed
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:277: 2022-08-23 16:40:57 Inject Ground Truth: adservice-5f6585d649-fnmft, cpu_consumed score 1
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:315: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource alert CpuUsageRate(%)
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:326:
[INFO]2023-08-20 03:06:26,400 pattern_ranker.py:329: [1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:343: -------- hipster Fault numbuer : 56-------
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:344: --------AIS@1 Result-------
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:345: 92.857143 %
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:346: --------AIS@3 Result-------
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:347: 96.428571 %
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:348: --------AIS@5 Result-------
[INFO]2023-08-20 03:06:26,401 pattern_ranker.py:349: 96.428571 %