OnlineBoutique_service_result.log

[INFO]2023-08-20 01:49:47,617 main.py:42: ------- OnlineBoutique Result at service level -------
[INFO]2023-08-20 01:50:11,669 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:50:30,709 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:50:46,584 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:50:56,769 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:50:57,006 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '104_106', 'score': 0.7028169014084507, 'deepth': 2, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 01:50:57,087 pattern_ranker.py:551: 2022-08-22 03:53:10 Inject RCA Pod Result:
[INFO]2023-08-20 01:50:57,088 pattern_ranker.py:553: 2022-08-22 03:53:10 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention
[INFO]2023-08-20 01:50:57,088 pattern_ranker.py:566: 2022-08-22 03:53:10 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_contention score 1
[INFO]2023-08-20 01:50:57,088 pattern_ranker.py:604: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource CpuUsageRate(%)
[INFO]2023-08-20 01:50:57,088 pattern_ranker.py:607: source :currencyservice grpc.hipstershop.CurrencyService/Convert start, target: currencyservice hipstershop.CurrencyService/Carry start, score: 0.7028169014084507, deepth: 2, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 01:50:57,088 pattern_ranker.py:608: 
[INFO]2023-08-20 01:51:09,719 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:51:25,223 data_integrate.py:550: Data Integrate Complete!
[ERROR]2023-08-20 01:51:27,078 pattern_ranker.py:191: Catch an exception: pop index out of range
[INFO]2023-08-20 01:51:27,079 pattern_ranker.py:198: Soted Result List: [{'events': '120_198', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_119', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '28_120', 'score': 1.0, 'deepth': 4, 'pod': 'adservice-5f6585d649-fnmft', 'resource': 'MemoryUsageRate(%)'}, {'events': '18_78', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_17', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_80', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_82', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_84', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '18_86', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}, {'events': '16_15', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 01:51:27,310 pattern_ranker.py:551: 2022-08-22 04:02:07 Inject RCA Pod Result:
[INFO]2023-08-20 01:51:27,310 pattern_ranker.py:553: 2022-08-22 04:02:07 Inject Ground Truth: frontend-579b9bff58-t2dbm, return
[INFO]2023-08-20 01:51:27,311 pattern_ranker.py:582: 2022-08-22 04:02:07 Inject Ground Truth: frontend-579b9bff58-t2dbm, return score 2
[INFO]2023-08-20 01:51:27,311 pattern_ranker.py:604: source :adservice hipstershop.AdService/<:SPANID:> start, target: MemoryUsageRate(%), score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource MemoryUsageRate(%)
[INFO]2023-08-20 01:51:27,311 pattern_ranker.py:604: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdServiceImpl/getAds end, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource MemoryUsageRate(%)
[INFO]2023-08-20 01:51:27,311 pattern_ranker.py:604: source :<:NUM:>:<:NUM:>:<:NUM:>.<:NUM:> INFO - TraceID: <:TRACEID:> SpanID: <:SPANID:> Received ad request (context words=<:ITEM:>, target: adservice hipstershop.AdService/<:SPANID:> start, score: 1.0, deepth: 4, pod adservice-5f6585d649-fnmft, resource MemoryUsageRate(%)
[INFO]2023-08-20 01:51:27,311 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.ProductCatalogService/GetProduct start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/GetSupportedCurrencies start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CartService/GetCart start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.CurrencyService/Convert start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page started, target: frontend hipstershop.RecommendationService/ListRecommendations start, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Choose Ad complete, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Serving product page complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:51:27,312 pattern_ranker.py:608: 
[INFO]2023-08-20 01:51:44,296 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'frontend-579b9bff58-t2dbm', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:52:00,546 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:52:00,844 pattern_ranker.py:198: Soted Result List: [{'events': '76_4', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm', 'resource': 'CpuUsageRate(%)'}, {'events': '24_100', 'score': 0.75, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 01:52:00,926 pattern_ranker.py:551: 2022-08-22 04:10:20 Inject RCA Pod Result:
[INFO]2023-08-20 01:52:00,926 pattern_ranker.py:553: 2022-08-22 04:10:20 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed
[INFO]2023-08-20 01:52:00,926 pattern_ranker.py:566: 2022-08-22 04:10:20 Inject Ground Truth: frontend-579b9bff58-t2dbm, cpu_consumed score 1
[INFO]2023-08-20 01:52:00,926 pattern_ranker.py:604: source :frontend hipstershop.Frontend/Recv. start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Request started, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm, resource CpuUsageRate(%)
[INFO]2023-08-20 01:52:00,927 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 0.75, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 01:52:00,927 pattern_ranker.py:608: 
[INFO]2023-08-20 01:52:23,993 data_integrate.py:481: [{'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:52:45,364 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:52:45,449 pattern_ranker.py:198: Soted Result List: [{'events': '50_49', 'score': 1.0, 'deepth': 1, 'pod': 'frontend-579b9bff58-t2dbm'}]
[INFO]2023-08-20 01:52:45,566 pattern_ranker.py:551: 2022-08-22 04:18:35 Inject RCA Pod Result:
[INFO]2023-08-20 01:52:45,566 pattern_ranker.py:553: 2022-08-22 04:18:35 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception
[INFO]2023-08-20 01:52:45,566 pattern_ranker.py:582: 2022-08-22 04:18:35 Inject Ground Truth: frontend-579b9bff58-t2dbm, exception score 1
[INFO]2023-08-20 01:52:45,566 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Placing order started, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> Order placed complete, score: 1.0, deepth: 1, pod frontend-579b9bff58-t2dbm
[INFO]2023-08-20 01:52:45,566 pattern_ranker.py:608: 
[INFO]2023-08-20 01:53:06,529 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'NetworkP90(ms)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:53:25,418 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:53:25,994 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'NetworkP90(ms)'}, {'events': '24_100', 'score': 1.0, 'deepth': 3, 'pod': 'currencyservice-cf787dd48-vpjrd'}]
[INFO]2023-08-20 01:53:26,104 pattern_ranker.py:551: 2022-08-22 04:27:03 Inject RCA Pod Result:
[INFO]2023-08-20 01:53:26,104 pattern_ranker.py:553: 2022-08-22 04:27:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay
[INFO]2023-08-20 01:53:26,104 pattern_ranker.py:566: 2022-08-22 04:27:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, network_delay score 1
[INFO]2023-08-20 01:53:26,104 pattern_ranker.py:604: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource NetworkP90(ms)
[INFO]2023-08-20 01:53:26,105 pattern_ranker.py:607: source :TraceID: <:TRACEID:> SpanID: <:SPANID:> Getting supported currencies..., target: currencyservice hipstershop.CurrencyService/GetCurrencyData start, score: 1.0, deepth: 3, pod currencyservice-cf787dd48-vpjrd
[INFO]2023-08-20 01:53:26,105 pattern_ranker.py:608: 
[INFO]2023-08-20 01:53:49,661 data_integrate.py:481: [{'pod': 'cartservice-579f59597d-wc2lz', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:54:12,662 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:54:13,002 pattern_ranker.py:198: Soted Result List: [{'events': '102_25', 'score': 1.0, 'deepth': 6, 'pod': 'cartservice-579f59597d-wc2lz', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 01:54:13,128 pattern_ranker.py:551: 2022-08-22 04:36:03 Inject RCA Pod Result:
[INFO]2023-08-20 01:54:13,128 pattern_ranker.py:553: 2022-08-22 04:36:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention
[INFO]2023-08-20 01:54:13,129 pattern_ranker.py:566: 2022-08-22 04:36:03 Inject Ground Truth: cartservice-579f59597d-wc2lz, cpu_contention score 1
[INFO]2023-08-20 01:54:13,129 pattern_ranker.py:604: source :cartservice hipstershop.CartService/GetCart start, target: TraceID: <:TRACEID:> SpanID: <:SPANID:> GetCartAsync called with userId=<:USERID:>, score: 1.0, deepth: 6, pod cartservice-579f59597d-wc2lz, resource CpuUsageRate(%)
[INFO]2023-08-20 01:54:13,129 pattern_ranker.py:608: 
[INFO]2023-08-20 01:54:35,997 data_integrate.py:481: [{'pod': 'checkoutservice-578fcf4766-9csqn', 'alarm': [{'metric_type': 'CpuUsageRate(%)', 'alarm_flag': True}]}, {'pod': 'adservice-5f6585d649-fnmft', 'alarm': [{'metric_type': 'MemoryUsageRate(%)', 'alarm_flag': True}]}]
[INFO]2023-08-20 01:54:59,034 data_integrate.py:550: Data Integrate Complete!
[INFO]2023-08-20 01:54:59,474 pattern_ranker.py:198: Soted Result List: [{'events': '158_65', 'score': 1.0, 'deepth': 4, 'pod': 'checkoutservice-578fcf4766-9csqn', 'resource': 'CpuUsageRate(%)'}]
[INFO]2023-08-20 01:54:59,576 pattern_ranker.py:551: 2022-08-22 04:44:16 Inject RCA Pod Result:
[INFO]2023-08-20 01:54:59,576 pattern_ranker.py:553: 2022-08-22 04:44:16 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_contention
[INFO]2023-08-20 01:54:59,576 pattern_ranker.py:566: 2022-08-22 04:44:16 Inject Ground Truth: checkoutservice-578fcf4766-9csqn, cpu_contention score 1