You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/plugins/inputs/elasticsearch.asciidoc
+6-8Lines changed: 6 additions & 8 deletions
Original file line number
Diff line number
Diff line change
@@ -107,8 +107,6 @@ Common causes are:
107
107
[id="plugins-{type}s-{plugin}-cursor"]
108
108
==== Tracking a field's value across runs
109
109
110
-
NOTE: experimental:[] `tracking_field` and related settings are experimental and subject to change in the future
111
-
112
110
.Technical Preview: Tracking a field's value
113
111
****
114
112
The feature that allows tracking a field's value across runs is in _Technical Preview_.
@@ -124,7 +122,7 @@ Examples include:
124
122
The Elasticsearch input plugin provides the <<plugins-{type}s-{plugin}-tracking_field>> and <<plugins-{type}s-{plugin}-tracking_field_seed>> options.
125
123
When <<plugins-{type}s-{plugin}-tracking_field>> is set, the plugin records the value of that field for the last document retrieved in a run into
126
124
a file.
127
-
(The file location defaults to <<plugins-{type}s-{plugin}-last_run_metadata_path>>).
125
+
(The file location defaults to <<plugins-{type}s-{plugin}-last_run_metadata_path>>.)
128
126
129
127
You can then inject this value in the query using the placeholder `:last_value`.
130
128
The value will be injected into the query before execution, and then updated after the query completes if new data was found.
@@ -140,11 +138,10 @@ If the tracking field is of this data type, you can use an extra placeholder cal
140
138
This placeholder is useful as the right-hand side of a range filter, allowing the collection of
141
139
new data but leaving partially-searchable bulk request data to the next scheduled job.
142
140
143
-
[id="plugins-{type}s-{plugin}-tracking-sample"]
141
+
id="plugins-{type}s-{plugin}-tracking-sample"]
144
142
===== Sample configuration: Track field value across runs
145
143
146
-
This section contains a series of steps to help you set up the "tailing" of data being written to a set of indices, using a date nanosecond field
147
-
added by an Elasticsearch ingest pipeline and the `tracking_field` capability of this plugin.
144
+
This section contains a series of steps to help you set up the "tailing" of data being written to a set of indices, using a date nanosecond field added by an Elasticsearch ingest pipeline and the `tracking_field` capability of this plugin.
148
145
149
146
. Create ingest pipeline that adds Elasticsearch's `_ingest.timestamp` field to the documents as `event.ingested`:
150
147
+
@@ -162,7 +159,8 @@ added by an Elasticsearch ingest pipeline and the `tracking_field` capability of
162
159
}
163
160
164
161
[start=2]
165
-
. Create an index mapping where the tracking field is of date nanosecond type and invokes the defined pipeline:+
162
+
. Create an index mapping where the tracking field is of date nanosecond type and invokes the defined pipeline:
163
+
+
166
164
[source, json]
167
165
PUT /_template/my_template
168
166
{
@@ -832,4 +830,4 @@ The plugin will fail to start if it contains any of these obsolete options.
0 commit comments