nginx proxy MISS
Slawa Olhovchenkov
slw на zxy.spb.ru
Пн Авг 10 14:07:00 UTC 2020
On Mon, Aug 10, 2020 at 06:38:11PM +0500, Илья Шипицин wrote:
> а содержимое файла /720p_02815.ts может меняться ?
я же показал что таймстамп июньский.
> если контент уникален, может включить proxy store ?
а как объем контролировать и устаревание?
и в принципе да, содержимое меняться теоретически может.
> пн, 10 авг. 2020 г. в 18:04, Slawa Olhovchenkov <slw на zxy.spb.ru>:
>
> > On Mon, Aug 10, 2020 at 03:40:58PM +0300, Maxim Dounin wrote:
> >
> > > Hello!
> > >
> > > On Mon, Aug 10, 2020 at 11:22:57AM +0300, Slawa Olhovchenkov wrote:
> > >
> > > > On Mon, Aug 10, 2020 at 03:26:25AM +0300, Maxim Dounin wrote:
> > > >
> > > > > Hello!
> > > > >
> > > > > On Mon, Aug 10, 2020 at 12:13:09AM +0300, Slawa Olhovchenkov wrote:
> > > > >
> > > > > > Есть файл, не меняется, заголовков про expire не имеет.
> > > > > >
> > > > > > Response: {'status': 200, 'headers': {'content-length': '615700',
> > 'x-rgw-object-type': 'Normal', 'accept-ranges': 'bytes', 'last-modified':
> > 'Wed, 08 Jul 2020 01:35:48 GMT', 'connection': 'Keep-Alive', 'etag':
> > '"1f722dbb169b83ea4f5897d638d39c8d"', 'x-amz-request-id':
> > > > > > 'tx00000000000000451618a-005f306158-a6edb7b-default', 'date':
> > 'Sun, 09 Aug 2020 20:49:28 GMT', 'content-type': 'video/MP2T'}, 'reason':
> > 'OK'}
> > > > > >
> > > > > > 188.242.226.75 :62964 [30/Jul/2020:21:01:48 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 MISS 0.000 0.016 616206
> > > > > > 212.164.64.179 :6700 [30/Jul/2020:21:01:50 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 109.94.87.178 :56019 [30/Jul/2020:21:01:51 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 165.225.66.51 :3581 [30/Jul/2020:21:01:46 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 MISS 0.000 0.043 616196
> > > > > > 176.59.135.87 :41598 [30/Jul/2020:21:01:47 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 178.184.45.0 :45255 [30/Jul/2020:21:01:50 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 85.26.233.17 :6656 [30/Jul/2020:21:01:59 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 91.214.220.143 :43841 [30/Jul/2020:21:01:59 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 128.71.141.232 :57462 [30/Jul/2020:21:02:31 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > > 5.167.161.39 :64139 [30/Jul/2020:21:02:36 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616316 HIT - - -
> > > > > > 95.105.98.204 :49869 [30/Jul/2020:21:02:34 +0300] "GET
> > /720p_02815.ts HTTP/1.1" 200 616316 MISS 0.000 0.020 616032
> > > > > >
> > > > > > какие причины могут быть для возникновения MISS?
> > > > > >
> > > > > > зона не заполнена даже наполовину.
> > > > > > proxy_cache_path /cache keys_zone=RGW:1000m levels=2:2
> > max_size=6000g inactive=10d use_temp_path=off;
> > > > >
> > > > > Если выше показаны заголовки ответа бэкенда, то я в первую очередь
> > > > > не вижу, почему бы этому файлу кэшироваться. То есть - каковы
> > > > > причины для возникновения HIT?
> > > > >
> > > > > В отсутствии явно заданных заголовков Cache-Control / Expire /
> > > > > X-Accel-Expire - единственная возможная причина кэширования это
> > > > > директива proxy_cache_valid, если она в конфиге есть - то
> > > > > вероятнее всего отвечает на оба вопроса.
> > > >
> > > > proxy_cache_valid 200 5d;
> > >
> > > Я бы ещё внимательно посмотрел на тайминги. Непонятно, что за
> > > времена приведены в логах, но $request_time там точно нет, а если
> >
> > $request_time $connection $upstream_cache_status $upstream_connect_time
> > $upstream_response_time $upstream_bytes_received
> >
> > > запросы общаются с бэкендом одновременно и proxy_cache_lock не
> >
> > да не вопрос.
> >
> > > используется - то и MISS'ов может быть одновременно много, при
> > > этом завершаться запросы могут в заметно разное время.
> >
> > не понимаю. вот есть первый запрос, окончился в 21:01:48, начался ну пусть
> > в 21:01:47. апстрим отдался почти мгновенно.
> > теперь на 5 дней должен быть хит независимо от. а в логе то хит то мисс.
> >
> > 188.242.226.75 :62964 [30/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.106 78233513 MISS 0.000 0.016 616206
> > 212.164.64.179 :6700 [30/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.409 71530389 HIT - - -
> > 109.94.87.178 :56019 [30/Jul/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.106 78883331 HIT - - -
> > 165.225.66.51 :3581 [30/Jul/2020:21:01:46 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.045 78875231 MISS 0.000 0.043 616196
> > 176.59.135.87 :41598 [30/Jul/2020:21:01:47 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.973 78738732 HIT - - -
> > 178.184.45.0 :45255 [30/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.000 73778063 HIT - - -
> > 85.26.233.17 :6656 [30/Jul/2020:21:01:59 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.001 73446584 HIT - - -
> > 91.214.220.143 :43841 [30/Jul/2020:21:01:59 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.331 77746051 HIT - - -
> > 128.71.141.232 :57462 [30/Jul/2020:21:02:31 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.444 78915833 HIT - - -
> > 5.167.161.39 :64139 [30/Jul/2020:21:02:36 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.318 78021062 HIT - - -
> > 95.105.98.204 :49869 [30/Jul/2020:21:02:34 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.144 77651040 MISS 0.000 0.020 616032
> > 95.153.130.125 :44399 [30/Jul/2020:21:04:23 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.109 79016152 HIT - - -
> > 188.242.86.10 :33086 [31/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.146 142965396 HIT - - -
> > 185.150.15.3 :43144 [31/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.585 147489940 HIT - - -
> > 5.139.125.143 :45274 [31/Jul/2020:21:01:52 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.000 139348909 HIT - - -
> > 2.93.146.181 :64401 [31/Jul/2020:21:01:52 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.331 147881538 HIT - - -
> > 45.14.20.210 :56346 [31/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.557 147593212 MISS 0.000 0.034 616196
> > 176.15.175.107 :64656 [31/Jul/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.045 138478791 HIT - - -
> > 31.173.27.253 :24479 [31/Jul/2020:21:02:15 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.336 138765630 HIT - - -
> > 31.8.119.217 :44474 [01/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.001 175116 HIT - - -
> > 93.157.255.141 :55898 [01/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.003 184720 HIT - - -
> > 188.242.226.75 :50497 [01/Aug/2020:21:02:41 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.020 196184 MISS 0.000 0.019 616206
> > 85.249.93.174 :61175 [01/Aug/2020:21:02:42 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.033 177157 MISS 0.000 0.005 616032
> > 85.249.93.174 :61175 [01/Aug/2020:21:04:11 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.074 177157 HIT - - -
> > 195.91.235.1 :51530 [02/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.051 30760317 HIT - - -
> > 178.35.97.85 :39544 [02/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.610 30713067 MISS 0.000 0.059 616196
> > 185.210.141.93 :31497 [02/Aug/2020:21:01:53 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.001 27394454 HIT - - -
> > 95.106.51.194 :49978 [02/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.083 30106701 HIT - - -
> > 31.173.242.246 :43492 [02/Aug/2020:21:02:18 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.125 30729007 HIT - - -
> > 178.214.244.168 :62584 [02/Aug/2020:21:02:37 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.064 27345988 MISS 0.000 0.063 616032
> > 5.59.246.39 :54222 [03/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.627 75630042 HIT - - -
> > 178.46.84.175 :1297 [03/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.646 82246680 MISS 0.001 0.009 616206
> > 31.42.202.16 :54256 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 1.024 82699416 HIT - - -
> > 178.141.203.153 :49142 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.083 82933835 HIT - - -
> > 95.106.51.194 :64821 [03/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.081 81742475 HIT - - -
> > 37.57.177.193 :40080 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.173 81979125 HIT - - -
> > 109.126.206.105 :32934 [03/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.423 82865568 HIT - - -
> > 188.162.48.9 :53456 [03/Aug/2020:21:01:54 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.219 82944963 HIT - - -
> > 77.222.122.114 :51574 [03/Aug/2020:21:01:46 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.092 75876544 MISS 0.000 0.092 616196
> > 85.140.27.24 :30386 [03/Aug/2020:21:01:53 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.000 79100194 HIT - - -
> > 81.177.200.155 :37464 [03/Aug/2020:21:02:04 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.001 82246005 HIT - - -
> > 95.27.40.105 :6659 [03/Aug/2020:21:02:14 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.000 79931961 HIT - - -
> > 217.107.126.16 :1690 [03/Aug/2020:21:02:30 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.150 83000660 MISS 0.000 0.009 616032
> > 89.113.139.97 :20539 [03/Aug/2020:21:02:44 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.375 82804373 HIT - - -
> > 188.233.116.101 :46197 [04/Aug/2020:21:01:47 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.249 137854093 MISS 0.000 0.091 616196
> > 91.221.176.225 :35008 [04/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.781 139347091 HIT - - -
> > 37.112.20.234 :14044 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.221 139452444 HIT - - -
> > 5.172.21.239 :48116 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.809 139288096 HIT - - -
> > 89.232.84.205 :52780 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.334 139454730 HIT - - -
> > 77.222.122.52 :49651 [04/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.001 133695884 HIT - - -
> > 90.151.84.91 :1123 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.490 139195030 HIT - - -
> > 2.56.181.13 :50021 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.178 139435015 HIT - - -
> > 94.51.121.147 :64072 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.226 139382518 MISS 0.000 0.013 616206
> > 92.124.204.243 :3506 [04/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.432 132803534 HIT - - -
> > 128.69.245.154 :42206 [04/Aug/2020:21:02:01 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.445 138341412 HIT - - -
> > 194.15.118.1 :51417 [04/Aug/2020:21:02:34 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 1.224 136548989 MISS 0.000 0.008 616032
> > 89.113.189.95 :51856 [04/Aug/2020:21:02:40 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.000 136555467 HIT - - -
> > 109.105.70.145 :53657 [05/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.352 190821258 HIT - - -
> > 89.169.48.215 :49391 [05/Aug/2020:21:01:54 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.034 190437436 HIT - - -
> > 178.46.116.40 :1291 [05/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 1.954 199717854 MISS 0.000 0.027 616206
> > 5.18.254.171 :5066 [05/Aug/2020:21:01:52 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.000 192022051 HIT - - -
> > 78.29.103.136 :49362 [05/Aug/2020:21:01:59 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.393 199373868 HIT - - -
> > 78.37.193.55 :42336 [05/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.090 199524641 MISS 0.000 0.012 616196
> > 46.147.234.69 :49796 [05/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.192 198440282 HIT - - -
> > 31.173.31.32 :2698 [05/Aug/2020:21:02:33 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.220 199860483 MISS 0.000 0.008 616032
> > 85.26.232.197 :42741 [05/Aug/2020:21:03:08 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.001 199675636 HIT - - -
> > 176.214.139.229 :54162 [07/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.174 320872769 MISS 0.001 0.031 616196
> > 178.70.10.90 :42298 [07/Aug/2020:21:02:24 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.089 311085923 HIT - - -
> > 46.146.255.161 :65434 [07/Aug/2020:21:02:30 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.276 319791320 MISS 0.000 0.006 616032
> > 213.87.120.119 :15102 [07/Aug/2020:21:02:37 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.457 322097116 HIT - - -
> > 46.45.199.227 :64596 [08/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.300 402068415 HIT - - -
> > 109.252.29.102 :6096 [08/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.233 392777294 MISS 0.000 0.181 616196
> > 94.50.150.211 :64486 [08/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 0.398 401696010 MISS 0.000 0.011 616206
> > 85.140.12.87 :5579 [08/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616330 1.038 401915843 HIT - - -
> > 5.166.124.28 :52152 [08/Aug/2020:21:02:27 +0300] "GET /720p_02815.ts
> > HTTP/1.1" 200 616316 0.513 396688107 MISS 0.000 0.009 616032
> > _______________________________________________
> > nginx-ru mailing list
> > nginx-ru на nginx.org
> > http://mailman.nginx.org/mailman/listinfo/nginx-ru
> _______________________________________________
> nginx-ru mailing list
> nginx-ru на nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx-ru
Подробная информация о списке рассылки nginx-ru