{"expand":"renderedFields,names,schema,operations,editmeta,changelog,versionedRepresentations","id":"27453","self":"https://jira.geedge.net/rest/api/2/issue/27453","key":"OMPUB-513","fields":{"issuetype":{"self":"https://jira.geedge.net/rest/api/2/issuetype/10004","id":"10004","description":"","iconUrl":"https://jira.geedge.net/secure/viewavatar?size=xsmall&avatarId=10303&avatarType=issuetype","name":"故障","subtask":false,"avatarId":10303},"components":[],"timespent":null,"timeoriginalestimate":null,"description":"2022.06.07 下午14点，用户生效了一个端口Monitor策略后，部分功能端出现大量丢日志的现象\r\n2022.06.07 晚关闭该策略，功能端就不丢日志了\r\n2022.06.08 白天继续打开该策略，用于排查丢日志现象\r\n\r\n下图是2022.06.07下午统计的各个功能端发送日志情况：\r\n !screenshot-1.png|thumbnail! \r\n\r\n备注：\r\n目前福州OLAP、泉州OLAP的kafka各3台\r\n功能端出现丢日志现象时，服务器网卡带宽约 7~9MB/s\r\n","project":{"self":"https://jira.geedge.net/rest/api/2/project/10206","id":"10206","key":"OMPUB","name":"Operation and Maintenance","projectTypeKey":"business","avatarUrls":{"48x48":"https://jira.geedge.net/secure/projectavatar?pid=10206&avatarId=10715","24x24":"https://jira.geedge.net/secure/projectavatar?size=small&pid=10206&avatarId=10715","16x16":"https://jira.geedge.net/secure/projectavatar?size=xsmall&pid=10206&avatarId=10715","32x32":"https://jira.geedge.net/secure/projectavatar?size=medium&pid=10206&avatarId=10715"},"projectCategory":{"self":"https://jira.geedge.net/rest/api/2/projectCategory/10002","id":"10002","description":"系统运维","name":"MaintenanceDev"}},"fixVersions":[],"aggregatetimespent":null,"resolution":{"self":"https://jira.geedge.net/rest/api/2/resolution/10000","id":"10000","description":"该问题的工作流程已完成。","name":"完成"},"timetracking":{},"customfield_10401":null,"customfield_10104":["com.atlassian.greenhopper.service.sprint.Sprint@11d006de[id=145,rapidViewId=41,state=CLOSED,name=Firewall测试Bug,startDate=2022-03-01T09:17:00.000+08:00,endDate=2022-03-31T20:17:00.000+08:00,completeDate=2024-02-22T10:27:24.250+08:00,activatedDate=2020-09-14T09:17:30.028+08:00,sequence=145,goal=,autoStartStop=false]"],"customfield_10402":null,"customfield_10105":"0|i02v30:","customfield_10403":null,"customfield_10404":null,"attachment":[{"self":"https://jira.geedge.net/rest/api/2/attachment/28502","id":"28502","filename":"FJ-Kafka-IO.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T17:35:24.486+0800","size":55005,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/28502/FJ-Kafka-IO.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/28502/_thumb_28502.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/28453","id":"28453","filename":"image-2022-06-08-09-33-57-327.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=liuxueli","name":"liuxueli","key":"JIRAUSER10133","emailAddress":"liuxueli@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10133&avatarId=10612","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10133&avatarId=10612","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10133&avatarId=10612","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10133&avatarId=10612"},"displayName":"刘学利","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T09:33:58.545+0800","size":54667,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/28453/image-2022-06-08-09-33-57-327.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/28453/_thumb_28453.png"},{"self":"https://jira.geedge.net/rest/api/2/attachment/28451","id":"28451","filename":"screenshot-1.png","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=zhangzhihan","name":"zhangzhihan","key":"JIRAUSER10111","emailAddress":"zhangzhihan@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10111&avatarId=12001","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10111&avatarId=12001","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10111&avatarId=12001","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10111&avatarId=12001"},"displayName":"张智涵","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T09:23:20.448+0800","size":87478,"mimeType":"image/png","content":"https://jira.geedge.net/secure/attachment/28451/screenshot-1.png","thumbnail":"https://jira.geedge.net/secure/thumbnail/28451/_thumb_28451.png"}],"aggregatetimeestimate":null,"resolutiondate":"2022-06-28T09:55:22.544+0800","workratio":-1,"summary":"福建项目：功能端发日志出现大量丢日志的现象","lastViewed":null,"watches":{"self":"https://jira.geedge.net/rest/api/2/issue/OMPUB-513/watchers","watchCount":4,"isWatching":false},"creator":{"self":"https://jira.geedge.net/rest/api/2/user?username=zhangzhihan","name":"zhangzhihan","key":"JIRAUSER10111","emailAddress":"zhangzhihan@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10111&avatarId=12001","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10111&avatarId=12001","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10111&avatarId=12001","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10111&avatarId=12001"},"displayName":"张智涵","active":true,"timeZone":"Asia/Shanghai"},"subtasks":[],"created":"2022-06-08T09:22:56.179+0800","reporter":{"self":"https://jira.geedge.net/rest/api/2/user?username=zhangzhihan","name":"zhangzhihan","key":"JIRAUSER10111","emailAddress":"zhangzhihan@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10111&avatarId=12001","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10111&avatarId=12001","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10111&avatarId=12001","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10111&avatarId=12001"},"displayName":"张智涵","active":true,"timeZone":"Asia/Shanghai"},"customfield_10000":"{summaryBean=com.atlassian.jira.plugin.devstatus.rest.SummaryBean@56d0b8ae[summary={pullrequest=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@3a2c3b86[overall=PullRequestOverallBean{stateCount=0, state='OPEN', details=PullRequestOverallDetails{openCount=0, mergedCount=0, declinedCount=0}},byInstanceType={}], build=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@4d05e88c[overall=com.atlassian.jira.plugin.devstatus.summary.beans.BuildOverallBean@16ae0aa1[failedBuildCount=0,successfulBuildCount=0,unknownBuildCount=0,count=0,lastUpdated=,lastUpdatedTimestamp=],byInstanceType={}], review=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@7bacc122[overall=com.atlassian.jira.plugin.devstatus.summary.beans.ReviewsOverallBean@7cd91ac3[stateCount=0,state=,dueDate=,overDue=false,count=0,lastUpdated=,lastUpdatedTimestamp=],byInstanceType={}], deployment-environment=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@1e7adc5c[overall=com.atlassian.jira.plugin.devstatus.summary.beans.DeploymentOverallBean@78673630[topEnvironments=[],showProjects=false,successfulCount=0,count=0,lastUpdated=,lastUpdatedTimestamp=],byInstanceType={}], repository=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@65df4dcf[overall=com.atlassian.jira.plugin.devstatus.summary.beans.CommitOverallBean@51644cb5[count=0,lastUpdated=,lastUpdatedTimestamp=],byInstanceType={}], branch=com.atlassian.jira.plugin.devstatus.rest.SummaryItemBean@19b4f2f9[overall=com.atlassian.jira.plugin.devstatus.summary.beans.BranchOverallBean@58238149[count=0,lastUpdated=,lastUpdatedTimestamp=],byInstanceType={}]},errors=[],configErrors=[]], devSummaryJson={\"cachedValue\":{\"errors\":[],\"configErrors\":[],\"summary\":{\"pullrequest\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"stateCount\":0,\"state\":\"OPEN\",\"details\":{\"openCount\":0,\"mergedCount\":0,\"declinedCount\":0,\"total\":0},\"open\":true},\"byInstanceType\":{}},\"build\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"failedBuildCount\":0,\"successfulBuildCount\":0,\"unknownBuildCount\":0},\"byInstanceType\":{}},\"review\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"stateCount\":0,\"state\":null,\"dueDate\":null,\"overDue\":false,\"completed\":false},\"byInstanceType\":{}},\"deployment-environment\":{\"overall\":{\"count\":0,\"lastUpdated\":null,\"topEnvironments\":[],\"showProjects\":false,\"successfulCount\":0},\"byInstanceType\":{}},\"repository\":{\"overall\":{\"count\":0,\"lastUpdated\":null},\"byInstanceType\":{}},\"branch\":{\"overall\":{\"count\":0,\"lastUpdated\":null},\"byInstanceType\":{}}}},\"isStale\":false}}","aggregateprogress":{"progress":0,"total":0},"customfield_10100":null,"priority":{"self":"https://jira.geedge.net/rest/api/2/priority/3","iconUrl":"https://jira.geedge.net/images/icons/priorities/medium.svg","name":"Medium","id":"3"},"customfield_10200":null,"customfield_10400":null,"labels":["FUJIAN","OLAP性能"],"environment":null,"timeestimate":null,"aggregatetimeoriginalestimate":null,"versions":[],"duedate":null,"progress":{"progress":0,"total":0},"issuelinks":[],"comment":{"comments":[{"self":"https://jira.geedge.net/rest/api/2/issue/27453/comment/42270","id":"42270","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=liuxueli","name":"liuxueli","key":"JIRAUSER10133","emailAddress":"liuxueli@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10133&avatarId=10612","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10133&avatarId=10612","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10133&avatarId=10612","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10133&avatarId=10612"},"displayName":"刘学利","active":true,"timeZone":"Asia/Shanghai"},"body":"* 根据杨阳反馈：kafka一共有三台服务器，三台kafka的带宽分别是  88MB  74MB  104MB ，怀疑已经达到了服务器的磁盘写入速度。\r\n * kafka broker的性能不足导致功能端的kafka客户端报错 _QUEUE_FULL(Local: Queue full) ；参照: [https://github.com/confluentinc/confluent-kafka-go/issues/346]\r\n **   !image-2022-06-08-09-33-57-327.png!\r\n ** \r\n{code:java}\r\nTue Jun  7 18:35:58 2022, INFO, ./tsglog/tsglog, TSG_SEND_LOG, tsg_send_log to kafka is error of _QUEUE_FULL(Local: Queue full), status: -1, topic: SECURITY-EVENT payload:\r\nTue Jun  7 18:35:58 2022, INFO, ./tsglog/tsglog, TSG_SEND_LOG, tsg_send_log to kafka is error of _QUEUE_FULL(Local: Queue full), status: -1, topic: SECURITY-EVENT payload:{code}","updateAuthor":{"self":"https://jira.geedge.net/rest/api/2/user?username=liuxueli","name":"liuxueli","key":"JIRAUSER10133","emailAddress":"liuxueli@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10133&avatarId=10612","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10133&avatarId=10612","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10133&avatarId=10612","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10133&avatarId=10612"},"displayName":"刘学利","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T09:29:26.376+0800","updated":"2022-06-08T09:35:23.079+0800"},{"self":"https://jira.geedge.net/rest/api/2/issue/27453/comment/42319","id":"42319","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=zhangzhihan","name":"zhangzhihan","key":"JIRAUSER10111","emailAddress":"zhangzhihan@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10111&avatarId=12001","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10111&avatarId=12001","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10111&avatarId=12001","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10111&avatarId=12001"},"displayName":"张智涵","active":true,"timeZone":"Asia/Shanghai"},"body":"泉州OLAP三台部署kafka的服务器，写入在100MB/s时磁盘IO就已经达到100%，所以出现功能端丢日志现象\r\n最终将kafka从HDD切换到SSD后，写入正常，未出现IO高的问题，功能端也未丢日志\r\n后续将持续观察一段时间","updateAuthor":{"self":"https://jira.geedge.net/rest/api/2/user?username=zhangzhihan","name":"zhangzhihan","key":"JIRAUSER10111","emailAddress":"zhangzhihan@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10111&avatarId=12001","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10111&avatarId=12001","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10111&avatarId=12001","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10111&avatarId=12001"},"displayName":"张智涵","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T16:56:37.690+0800","updated":"2022-06-08T16:58:35.565+0800"},{"self":"https://jira.geedge.net/rest/api/2/issue/27453/comment/42323","id":"42323","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=doufenghu","name":"doufenghu","key":"JIRAUSER10107","emailAddress":"doufenghu@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10107&avatarId=11700","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10107&avatarId=11700","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10107&avatarId=11700","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10107&avatarId=11700"},"displayName":"窦凤虎","active":true,"timeZone":"Asia/Shanghai"},"body":"需要跟踪下100MB/s IO 达到100%问题。[~qidaijie] ","updateAuthor":{"self":"https://jira.geedge.net/rest/api/2/user?username=doufenghu","name":"doufenghu","key":"JIRAUSER10107","emailAddress":"doufenghu@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10107&avatarId=11700","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10107&avatarId=11700","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10107&avatarId=11700","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10107&avatarId=11700"},"displayName":"窦凤虎","active":true,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T17:13:24.504+0800","updated":"2022-06-08T17:13:31.127+0800"},{"self":"https://jira.geedge.net/rest/api/2/issue/27453/comment/42328","id":"42328","author":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"body":"现场情况：\r\n1：三台混部服务器仅有kafka使用磁盘；使用HDD时每秒写入次数在110左右，排除有大量小文件的情况。\r\n !FJ-Kafka-IO.png|thumbnail! \r\n2：Kafka使用SSD后，写入日志总量未变、Kafka配置未变动，使用率在20%左右。\r\n3：测试的HDD的IO性能与实际不符，需要对HDD阵列分析和重新测试IO。","updateAuthor":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"created":"2022-06-08T17:32:50.466+0800","updated":"2022-06-08T17:37:15.097+0800"}],"maxResults":4,"total":4,"startAt":0},"votes":{"self":"https://jira.geedge.net/rest/api/2/issue/OMPUB-513/votes","votes":0,"hasVoted":false},"worklog":{"startAt":0,"maxResults":20,"total":0,"worklogs":[]},"assignee":{"self":"https://jira.geedge.net/rest/api/2/user?username=qidaijie","name":"qidaijie","key":"JIRAUSER10135","emailAddress":"qidaijie@geedgenetworks.com","avatarUrls":{"48x48":"https://jira.geedge.net/secure/useravatar?ownerId=JIRAUSER10135&avatarId=10727","24x24":"https://jira.geedge.net/secure/useravatar?size=small&ownerId=JIRAUSER10135&avatarId=10727","16x16":"https://jira.geedge.net/secure/useravatar?size=xsmall&ownerId=JIRAUSER10135&avatarId=10727","32x32":"https://jira.geedge.net/secure/useravatar?size=medium&ownerId=JIRAUSER10135&avatarId=10727"},"displayName":"戚岱杰","active":false,"timeZone":"Asia/Shanghai"},"updated":"2023-03-22T10:54:56.750+0800","status":{"self":"https://jira.geedge.net/rest/api/2/status/10103","description":"这一问题被认为是完成, 这项决议是正确的。问题已关闭可以重新开放。","iconUrl":"https://jira.geedge.net/images/icons/statuses/generic.png","name":"已关闭","id":"10103","statusCategory":{"self":"https://jira.geedge.net/rest/api/2/statuscategory/3","id":3,"key":"done","colorName":"green","name":"完成"}}}}