Uploaded image for project: 'IGB'
  1. IGB
  2. IGBF-2572

Configure InfluxDB to only store 2 weeks of data

        Details

        • Type: Task
        • Status: Closed (View Workflow)
        • Priority: Major
        • Resolution: Done
        • Affects Version/s: None
        • Fix Version/s: None
        • Labels:
          None

          Description

          Situation: The current implementation of the CyVerse Terrain API endpoint monitoring using Grafana/InfluxDB/Telegraf will continue to add additional data to the InfluxDB indefinitely.

          Task: Configure InfluxDB so that it only stores only the most recent 2 weeks of data.

            Attachments

              Issue Links

              relates to

              Task - A task that needs to be done. IGBF-2484 Investigate: Tooling to automate testing Terrain API

              • Major - Major loss of function.
              • Closed

                Activity

                Ascending order - Click to sort in descending order
                Hide
                Permalink
                cdias1 Chester Dias (Inactive) added a comment -

                CREATE RETENTION POLICY "Retention_policy" ON "Grafana" DURATION 2w REPLICATION 1

                Reference Link: https://docs.influxdata.com/influxdb/v1.8/guides/downsample_and_retain/

                Show
                cdias1 Chester Dias (Inactive) added a comment - CREATE RETENTION POLICY "Retention_policy" ON "Grafana" DURATION 2w REPLICATION 1 Reference Link: https://docs.influxdata.com/influxdb/v1.8/guides/downsample_and_retain/
                Hide
                Permalink
                cdias1 Chester Dias (Inactive) added a comment -

                Policies can be created via Grafana UI on
                https://grafana.bioviz.org/

                Login->Left panel menu ->explore and write the above query

                Show
                cdias1 Chester Dias (Inactive) added a comment - Policies can be created via Grafana UI on https://grafana.bioviz.org/ Login->Left panel menu ->explore and write the above query
                Hide
                Permalink
                cdias1 Chester Dias (Inactive) added a comment -

                Attached is screenshot verification of policy for 2 week storage of data in effect

                Show
                cdias1 Chester Dias (Inactive) added a comment - Attached is screenshot verification of policy for 2 week storage of data in effect
                Hide
                Permalink
                cdias1 Chester Dias (Inactive) added a comment -

                To Check the policy Run the below query in the explore section of the Grafana UI as per screenshot
                SHOW RETENTION POLICIES ON "Grafana"

                Show
                cdias1 Chester Dias (Inactive) added a comment - To Check the policy Run the below query in the explore section of the Grafana UI as per screenshot SHOW RETENTION POLICIES ON "Grafana"
                Hide
                Permalink
                nfreese Nowlan Freese added a comment -

                Chester Dias does the retention policy need to be set as default?

                Show
                nfreese Nowlan Freese added a comment - Chester Dias does the retention policy need to be set as default?
                Hide
                Permalink
                cdias1 Chester Dias (Inactive) added a comment -

                Nowlan FreeseI am not very sure how the default policy works. I can see no data prior to 12th November in Grafana, I think it is safe to assume the old data is purged. No data of any earlier attempts seems to be present

                Show
                cdias1 Chester Dias (Inactive) added a comment - Nowlan Freese I am not very sure how the default policy works. I can see no data prior to 12th November in Grafana, I think it is safe to assume the old data is purged. No data of any earlier attempts seems to be present
                Hide
                Permalink
                nfreese Nowlan Freese added a comment -

                Closing issue.

                Show
                nfreese Nowlan Freese added a comment - Closing issue.

                  People

                  • Assignee:
                    cdias1 Chester Dias (Inactive)
                    Reporter:
                    nfreese Nowlan Freese
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    2 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved: