{"expand":"renderedFields,names,schema,operations,editmeta,changelog,versionedRepresentations","id":"25900","self":"https://jira.geedge.net/rest/api/2/issue/25900","key":"OMPUB-417","fields":{"issuetype":{"self":"https://jira.geedge.net/rest/api/2/issuetype/10004","id":"10004","description":"","iconUrl":"https://jira.geedge.net/secure/viewavatar?size=xsmall&avatarId=10303&avatarType=issuetype","name":"故障","subtask":false,"avatarId":10303},"components":[],"timespent":null,"timeoriginalestimate":null,"description":"{{按照数据集-图表库-报告结果的流程生成一份Overseas APP server IP和location的相关报告，名为whatsapp的报告无法生成，具体表现为：创建报告后，生成进度持续时间{*}非常久{*}，并且当进度达到90%左右突然跳到60%左右，一直如此循环，最终，进度显示在98%，报告生成失败。}}\r\n\r\n{{具体{*}操作步骤{*}如下：}}\r\n\r\n{{1.建立如图1-1所示名为Whatsapp Server IP and Location的数据集；}}\r\n\r\n{{2.再建立如图1-2所示名为Whatsapp TOP 10 Server IP and Location的图表库，并引用图1-1中的数据集;}}\r\n\r\n{{3.最后生成图1-3所示的报告结果;}}\r\n\r\n{{4.点击生成报告后，抓取了四次，按照时间顺序依次排列如图1-4所示，生成进度到90%之后又跳回68%，再次到94%又跳回81%，一直循环，最后报告会停止在进度98%的时候，显示生成报告失败;}}\r\n\r\n{{5.在此处，F12查看返回数据如图1-5所示，显示status=4，数据量也异常大，达到几百亿。}}","project":{"self":"https://jira.geedge.net/rest/api/2/project/10206","id":"10206","key":"OMPUB","name":"Operation and Maintenance","projectTypeKey":"business","avatarUrls":{"48x48":"https://jira.geedge.net/secure/projectavatar?pid=10206&avatarId=10715","24x24":"https://jira.geedge.net/secure/projectavatar?size=small&pid=10206&avatarId=10715","16x16":"https://jira.geedge.net/secure/projectavatar?size=xsmall&pid=10206&avatarId=10715","32x32":"https://jira.geedge.net/secure/projectavatar?size=medium&pid=10206&avatarId=10715"},"projectCategory":{"self":"https://jira.geedge.net/rest/api/2/projectCategory/10002","id":"10002","description":"系统运维","name":"MaintenanceDev"}},"fixVersions":[],"aggregatetimespent":null,"resolution":{"self":"https://jira.geedge.net/rest/api/2/resolution/10000","id":"10000","description":"该问题的工作流程已完成。","name":"完成"},"timetracking":{},"customfield_10401":null,"customfield_10104":null,"customfield_10402":null,"customfield_10105":"0|i02llo:","customfield_10403":null,"customfield_10404":null,"attachment":[{"self":"https://jira.geedge.net/rest/api/2/attachment/26282","id":"26282","filename":"报告原始sql","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"created":"2022-03-17T13:48:47.072+0800","size":1556,"mimeType":"text/html","content":"https://jira.geedge.net/secure/attachment/26282/%E6%8A%A5%E5%91%8A%E5%8E%9F%E5%A7%8Bsql"},{"self":"https://jira.geedge.net/rest/api/2/attachment/26230","id":"26230","filename":"图1-1 数据集页面.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-03-16T12:45:00.197+0800","size":43849,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/26230/%E5%9B%BE1-1+%E6%95%B0%E6%8D%AE%E9%9B%86%E9%A1%B5%E9%9D%A2.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/26230/_thumb_26230.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/26229","id":"26229","filename":"图1-2图表库页面.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-03-16T12:45:00.045+0800","size":32004,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/26229/%E5%9B%BE1-2%E5%9B%BE%E8%A1%A8%E5%BA%93%E9%A1%B5%E9%9D%A2.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/26229/_thumb_26229.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/26228","id":"26228","filename":"图1-3生成报告页面.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-03-16T12:45:00.254+0800","size":25165,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/26228/%E5%9B%BE1-3%E7%94%9F%E6%88%90%E6%8A%A5%E5%91%8A%E9%A1%B5%E9%9D%A2.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/26228/_thumb_26228.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/26227","id":"26227","filename":"图1-4生成进度详情.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-03-16T12:45:00.395+0800","size":68983,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/26227/%E5%9B%BE1-4%E7%94%9F%E6%88%90%E8%BF%9B%E5%BA%A6%E8%AF%A6%E6%83%85.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/26227/_thumb_26227.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/26226","id":"26226","filename":"图1-5 返回数据详情.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-03-16T12:45:00.481+0800","size":117978,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/26226/%E5%9B%BE1-5+%E8%BF%94%E5%9B%9E%E6%95%B0%E6%8D%AE%E8%AF%A6%E6%83%85.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/26226/_thumb_26226.png"}],"aggregatetimeestimate":null,"resolutiondate":"2022-03-17T13:59:54.950+0800","workratio":-1,"summary":"新疆联通报告生成错误","lastViewed":null,"watches":{"self":"https://jira.geedge.net/rest/api/2/issue/OMPUB-417/watchers","watchCount":2,"isWatching":false},"creator":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"subtasks":[],"created":"2022-03-16T12:52:07.314+0800","reporter":{"self":"https://jira.geedge.net/rest/api/2/user?username=jiayimeng","name":"jiayimeng","key":"JIRAUSER10223","emailAddress":"jiayimeng@zdjizhi.com","avatarUrls":{"48x48":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=48","24x24":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=24","16x16":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=16","32x32":"https://www.gravatar.com/avatar/b60d1aabf7a7b02f5cb23d2f8de58b80?d=mm&s=32"},"displayName":"贾依蒙","active":true,"timeZone":"Asia/Shanghai"},"customfield_10000":"{summaryBean=com.atlassian.jira.plugin.devstatus.rest.SummaryBean@3c2f3bf5[summary={pullrequest=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@4daac797[overall=PullRequestOverallBean{stateCount=0, state='OPEN', details=PullRequestOverallDetails{openCount=0, mergedCount=0, declinedCount=0}},byInstanceType={}], build=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@44ed131d[overall=com.atlassian.jira.plugin.devstatus.summary.beans.BuildOverallBean@5fe0f268[failedBuildCount=0,successfulBuildCount=0,unknownBuildCount=0,count=0,lastUpdated=<null>,lastUpdatedTimestamp=<null>],byInstanceType={}], review=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@7851473e[overall=com.atlassian.jira.plugin.devstatus.summary.beans.ReviewsOverallBean@3ac9e214[stateCount=0,state=<null>,dueDate=<null>,overDue=false,count=0,lastUpdated=<null>,lastUpdatedTimestamp=<null>],byInstanceType={}], deployment-environment=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@16907bab[overall=com.atlassian.jira.plugin.devstatus.summary.beans.DeploymentOverallBean@4e3ba8a3[topEnvironments=[],showProjects=false,successfulCount=0,count=0,lastUpdated=<null>,lastUpdatedTimestamp=<null>],byInstanceType={}], repository=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@3c217eed[overall=com.atlassian.jira.plugin.devstatus.summary.beans.CommitOverallBean@490de23f[count=0,lastUpdated=<null>,lastUpdatedTimestamp=<null>],byInstanceType={}], branch=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@5c559596[overall=com.atlassian.jira.plugin.devstatus.summary.beans.BranchOverallBean@4fb8400f[count=0,lastUpdated=<null>,lastUpdatedTimestamp=<null>],byInstanceType={}]},errors=[],configErrors=[]], devSummaryJson={\"cachedValue\":{\"errors\":[],\"configErrors\":[],\"summary\":{\"pullrequest\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"stateCount\":0,\"state\":\"OPEN\",\"details\":{\"openCount\":0,\"mergedCount\":0,\"declinedCount\":0,\"total\":0},\"open\":true},\"byInstanceType\":{}},\"build\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"failedBuildCount\":0,\"successfulBuildCount\":0,\"unknownBuildCount\":0},\"byInstanceType\":{}},\"review\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"stateCount\":0,\"state\":null,\"dueDate\":null,\"overDue\":false,\"completed\":false},\"byInstanceType\":{}},\"deployment-environment\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"topEnvironments\":[],\"showProjects\":false,\"successfulCount\":0},\"byInstanceType\":{}},\"repository\":{\"overall\":{\"count\":0,\"lastUpdated\":null},\"byInstanceType\":{}},\"branch\":{\"overall\":{\"count\":0,\"lastUpdated\":null},\"byInstanceType\":{}}}},\"isStale\":false}}","aggregateprogress":{"progress":0,"total":0},"customfield_10100":null,"priority":{"self":"https://jira.geedge.net/rest/api/2/priority/2","iconUrl":"https://jira.geedge.net/images/icons/priorities/high.svg","name":"High","id":"2"},"customfield_10200":null,"customfield_10400":null,"labels":["XJ"],"environment":null,"timeestimate":null,"aggregatetimeoriginalestimate":null,"versions":[],"duedate":"2022-03-20","progress":{"progress":0,"total":0},"issuelinks":[],"comment":{"comments":[{"self":"https://jira.geedge.net/rest/api/2/issue/25900/comment/38588","id":"38588","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"body":"1.此报告进度条出现循环的原因：因为union all加子查询造成进度条循环，ck需要将sql解析分为多段进行查询。此现象不影响最终查询结果。\r\n2.此报告查询的为xj联通一周的数据，数据量为3000亿，union all之后相同的查询执行了两次数据量达到6000亿，数据量较大。\r\n3.clickhouse解析执行union all查询的性能远低于分别进行多次查询的性能。\r\n\r\n综合以上原因此查询超时\r\n目前报告生成的SQL [^报告原始sql] ；对此查询进行优化，优化后sql如下：\r\n{code:sql}\r\nSELECT\r\n        CAST(\"Server Location\" AS varchar) AS \"Server Location\",\r\n        sum(\"Bytes Sent + Bytes Received\") AS \"Bytes Sent + Bytes Received\"\r\nFROM\r\n        (\r\n        SELECT\r\n                common_server_location AS \"Server Location\", common_server_ip AS \"Server IP\", sum(common_c2s_pkt_num + common_s2c_pkt_num) AS \"Packets Sent + Packets Received\", sum(common_c2s_byte_num + common_s2c_byte_num) AS \"Bytes Sent + Bytes Received\"\r\n        FROM\r\n                tsg_galaxy_v3.session_record AS session_record\r\n        WHERE\r\n                ((common_recv_time >= toDateTime('2022-03-06 00:00:00')\r\n                AND common_recv_time < toDateTime('2022-03-13 00:00:00')))\r\n                AND ((common_app_label = 'whatsapp'))\r\n        GROUP BY\r\n                \"Server Location\", \"Server IP\")\r\nGROUP BY\r\n        \"Server Location\" WITH ROLLUP\r\nORDER BY\r\n        \"Bytes Sent + Bytes Received\" DESC\r\nLIMIT 10  \r\n{code}\r\n使用{color:#FF0000}WITH ROLLUP{color} 也可以计算出total值，{*}计算时间缩短{*} 到{color:#FF0000}1000s{color}\r\n\r\n此优化函数仅针对于clickhouse数据库使用，优化需深入讨论；目前建议缩短报表查询时间，分段查询。","updateAuthor":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"created":"2022-03-17T13:49:59.099+0800","updated":"2022-03-17T13:58:16.465+0800"}],"maxResults":1,"total":1,"startAt":0},"votes":{"self":"https://jira.geedge.net/rest/api/2/issue/OMPUB-417/votes","votes":0,"hasVoted":false},"worklog":{"startAt":0,"maxResults":20,"total":0,"worklogs":[]},"assignee":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"updated":"2022-08-09T16:50:32.154+0800","status":{"self":"https://jira.geedge.net/rest/api/2/status/10103","description":"这一问题被认为是完成, 这项决议是正确的。问题已关闭可以重新开放。","iconUrl":"https://jira.geedge.net/images/icons/statuses/generic.png","name":"已关闭","id":"10103","statusCategory":{"self":"https://jira.geedge.net/rest/api/2/statuscategory/3","id":3,"key":"done","colorName":"green","name":"完成"}}}}