nginx proxy MISS
Илья Шипицин
chipitsine на gmail.com
Пн Авг 10 13:38:11 UTC 2020
а содержимое файла /720p_02815.ts может меняться ?
если контент уникален, может включить proxy store ?
пн, 10 авг. 2020 г. в 18:04, Slawa Olhovchenkov <slw на zxy.spb.ru>:
> On Mon, Aug 10, 2020 at 03:40:58PM +0300, Maxim Dounin wrote:
>
> > Hello!
> >
> > On Mon, Aug 10, 2020 at 11:22:57AM +0300, Slawa Olhovchenkov wrote:
> >
> > > On Mon, Aug 10, 2020 at 03:26:25AM +0300, Maxim Dounin wrote:
> > >
> > > > Hello!
> > > >
> > > > On Mon, Aug 10, 2020 at 12:13:09AM +0300, Slawa Olhovchenkov wrote:
> > > >
> > > > > Есть файл, не меняется, заголовков про expire не имеет.
> > > > >
> > > > > Response: {'status': 200, 'headers': {'content-length': '615700',
> 'x-rgw-object-type': 'Normal', 'accept-ranges': 'bytes', 'last-modified':
> 'Wed, 08 Jul 2020 01:35:48 GMT', 'connection': 'Keep-Alive', 'etag':
> '"1f722dbb169b83ea4f5897d638d39c8d"', 'x-amz-request-id':
> > > > > 'tx00000000000000451618a-005f306158-a6edb7b-default', 'date':
> 'Sun, 09 Aug 2020 20:49:28 GMT', 'content-type': 'video/MP2T'}, 'reason':
> 'OK'}
> > > > >
> > > > > 188.242.226.75 :62964 [30/Jul/2020:21:01:48 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 MISS 0.000 0.016 616206
> > > > > 212.164.64.179 :6700 [30/Jul/2020:21:01:50 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 109.94.87.178 :56019 [30/Jul/2020:21:01:51 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 165.225.66.51 :3581 [30/Jul/2020:21:01:46 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 MISS 0.000 0.043 616196
> > > > > 176.59.135.87 :41598 [30/Jul/2020:21:01:47 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 178.184.45.0 :45255 [30/Jul/2020:21:01:50 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 85.26.233.17 :6656 [30/Jul/2020:21:01:59 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 91.214.220.143 :43841 [30/Jul/2020:21:01:59 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 128.71.141.232 :57462 [30/Jul/2020:21:02:31 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616330 HIT - - -
> > > > > 5.167.161.39 :64139 [30/Jul/2020:21:02:36 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616316 HIT - - -
> > > > > 95.105.98.204 :49869 [30/Jul/2020:21:02:34 +0300] "GET
> /720p_02815.ts HTTP/1.1" 200 616316 MISS 0.000 0.020 616032
> > > > >
> > > > > какие причины могут быть для возникновения MISS?
> > > > >
> > > > > зона не заполнена даже наполовину.
> > > > > proxy_cache_path /cache keys_zone=RGW:1000m levels=2:2
> max_size=6000g inactive=10d use_temp_path=off;
> > > >
> > > > Если выше показаны заголовки ответа бэкенда, то я в первую очередь
> > > > не вижу, почему бы этому файлу кэшироваться. То есть - каковы
> > > > причины для возникновения HIT?
> > > >
> > > > В отсутствии явно заданных заголовков Cache-Control / Expire /
> > > > X-Accel-Expire - единственная возможная причина кэширования это
> > > > директива proxy_cache_valid, если она в конфиге есть - то
> > > > вероятнее всего отвечает на оба вопроса.
> > >
> > > proxy_cache_valid 200 5d;
> >
> > Я бы ещё внимательно посмотрел на тайминги. Непонятно, что за
> > времена приведены в логах, но $request_time там точно нет, а если
>
> $request_time $connection $upstream_cache_status $upstream_connect_time
> $upstream_response_time $upstream_bytes_received
>
> > запросы общаются с бэкендом одновременно и proxy_cache_lock не
>
> да не вопрос.
>
> > используется - то и MISS'ов может быть одновременно много, при
> > этом завершаться запросы могут в заметно разное время.
>
> не понимаю. вот есть первый запрос, окончился в 21:01:48, начался ну пусть
> в 21:01:47. апстрим отдался почти мгновенно.
> теперь на 5 дней должен быть хит независимо от. а в логе то хит то мисс.
>
> 188.242.226.75 :62964 [30/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.106 78233513 MISS 0.000 0.016 616206
> 212.164.64.179 :6700 [30/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.409 71530389 HIT - - -
> 109.94.87.178 :56019 [30/Jul/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.106 78883331 HIT - - -
> 165.225.66.51 :3581 [30/Jul/2020:21:01:46 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.045 78875231 MISS 0.000 0.043 616196
> 176.59.135.87 :41598 [30/Jul/2020:21:01:47 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.973 78738732 HIT - - -
> 178.184.45.0 :45255 [30/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.000 73778063 HIT - - -
> 85.26.233.17 :6656 [30/Jul/2020:21:01:59 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.001 73446584 HIT - - -
> 91.214.220.143 :43841 [30/Jul/2020:21:01:59 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.331 77746051 HIT - - -
> 128.71.141.232 :57462 [30/Jul/2020:21:02:31 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.444 78915833 HIT - - -
> 5.167.161.39 :64139 [30/Jul/2020:21:02:36 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.318 78021062 HIT - - -
> 95.105.98.204 :49869 [30/Jul/2020:21:02:34 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.144 77651040 MISS 0.000 0.020 616032
> 95.153.130.125 :44399 [30/Jul/2020:21:04:23 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.109 79016152 HIT - - -
> 188.242.86.10 :33086 [31/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.146 142965396 HIT - - -
> 185.150.15.3 :43144 [31/Jul/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.585 147489940 HIT - - -
> 5.139.125.143 :45274 [31/Jul/2020:21:01:52 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.000 139348909 HIT - - -
> 2.93.146.181 :64401 [31/Jul/2020:21:01:52 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.331 147881538 HIT - - -
> 45.14.20.210 :56346 [31/Jul/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.557 147593212 MISS 0.000 0.034 616196
> 176.15.175.107 :64656 [31/Jul/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.045 138478791 HIT - - -
> 31.173.27.253 :24479 [31/Jul/2020:21:02:15 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.336 138765630 HIT - - -
> 31.8.119.217 :44474 [01/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.001 175116 HIT - - -
> 93.157.255.141 :55898 [01/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.003 184720 HIT - - -
> 188.242.226.75 :50497 [01/Aug/2020:21:02:41 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.020 196184 MISS 0.000 0.019 616206
> 85.249.93.174 :61175 [01/Aug/2020:21:02:42 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.033 177157 MISS 0.000 0.005 616032
> 85.249.93.174 :61175 [01/Aug/2020:21:04:11 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.074 177157 HIT - - -
> 195.91.235.1 :51530 [02/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.051 30760317 HIT - - -
> 178.35.97.85 :39544 [02/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.610 30713067 MISS 0.000 0.059 616196
> 185.210.141.93 :31497 [02/Aug/2020:21:01:53 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.001 27394454 HIT - - -
> 95.106.51.194 :49978 [02/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.083 30106701 HIT - - -
> 31.173.242.246 :43492 [02/Aug/2020:21:02:18 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.125 30729007 HIT - - -
> 178.214.244.168 :62584 [02/Aug/2020:21:02:37 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.064 27345988 MISS 0.000 0.063 616032
> 5.59.246.39 :54222 [03/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.627 75630042 HIT - - -
> 178.46.84.175 :1297 [03/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.646 82246680 MISS 0.001 0.009 616206
> 31.42.202.16 :54256 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 1.024 82699416 HIT - - -
> 178.141.203.153 :49142 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.083 82933835 HIT - - -
> 95.106.51.194 :64821 [03/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.081 81742475 HIT - - -
> 37.57.177.193 :40080 [03/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.173 81979125 HIT - - -
> 109.126.206.105 :32934 [03/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.423 82865568 HIT - - -
> 188.162.48.9 :53456 [03/Aug/2020:21:01:54 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.219 82944963 HIT - - -
> 77.222.122.114 :51574 [03/Aug/2020:21:01:46 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.092 75876544 MISS 0.000 0.092 616196
> 85.140.27.24 :30386 [03/Aug/2020:21:01:53 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.000 79100194 HIT - - -
> 81.177.200.155 :37464 [03/Aug/2020:21:02:04 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.001 82246005 HIT - - -
> 95.27.40.105 :6659 [03/Aug/2020:21:02:14 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.000 79931961 HIT - - -
> 217.107.126.16 :1690 [03/Aug/2020:21:02:30 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.150 83000660 MISS 0.000 0.009 616032
> 89.113.139.97 :20539 [03/Aug/2020:21:02:44 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.375 82804373 HIT - - -
> 188.233.116.101 :46197 [04/Aug/2020:21:01:47 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.249 137854093 MISS 0.000 0.091 616196
> 91.221.176.225 :35008 [04/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.781 139347091 HIT - - -
> 37.112.20.234 :14044 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.221 139452444 HIT - - -
> 5.172.21.239 :48116 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.809 139288096 HIT - - -
> 89.232.84.205 :52780 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.334 139454730 HIT - - -
> 77.222.122.52 :49651 [04/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.001 133695884 HIT - - -
> 90.151.84.91 :1123 [04/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.490 139195030 HIT - - -
> 2.56.181.13 :50021 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.178 139435015 HIT - - -
> 94.51.121.147 :64072 [04/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.226 139382518 MISS 0.000 0.013 616206
> 92.124.204.243 :3506 [04/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.432 132803534 HIT - - -
> 128.69.245.154 :42206 [04/Aug/2020:21:02:01 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.445 138341412 HIT - - -
> 194.15.118.1 :51417 [04/Aug/2020:21:02:34 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 1.224 136548989 MISS 0.000 0.008 616032
> 89.113.189.95 :51856 [04/Aug/2020:21:02:40 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.000 136555467 HIT - - -
> 109.105.70.145 :53657 [05/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.352 190821258 HIT - - -
> 89.169.48.215 :49391 [05/Aug/2020:21:01:54 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.034 190437436 HIT - - -
> 178.46.116.40 :1291 [05/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 1.954 199717854 MISS 0.000 0.027 616206
> 5.18.254.171 :5066 [05/Aug/2020:21:01:52 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.000 192022051 HIT - - -
> 78.29.103.136 :49362 [05/Aug/2020:21:01:59 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.393 199373868 HIT - - -
> 78.37.193.55 :42336 [05/Aug/2020:21:01:49 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.090 199524641 MISS 0.000 0.012 616196
> 46.147.234.69 :49796 [05/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.192 198440282 HIT - - -
> 31.173.31.32 :2698 [05/Aug/2020:21:02:33 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.220 199860483 MISS 0.000 0.008 616032
> 85.26.232.197 :42741 [05/Aug/2020:21:03:08 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.001 199675636 HIT - - -
> 176.214.139.229 :54162 [07/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.174 320872769 MISS 0.001 0.031 616196
> 178.70.10.90 :42298 [07/Aug/2020:21:02:24 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.089 311085923 HIT - - -
> 46.146.255.161 :65434 [07/Aug/2020:21:02:30 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.276 319791320 MISS 0.000 0.006 616032
> 213.87.120.119 :15102 [07/Aug/2020:21:02:37 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.457 322097116 HIT - - -
> 46.45.199.227 :64596 [08/Aug/2020:21:01:51 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.300 402068415 HIT - - -
> 109.252.29.102 :6096 [08/Aug/2020:21:01:48 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.233 392777294 MISS 0.000 0.181 616196
> 94.50.150.211 :64486 [08/Aug/2020:21:01:50 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 0.398 401696010 MISS 0.000 0.011 616206
> 85.140.12.87 :5579 [08/Aug/2020:21:01:57 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616330 1.038 401915843 HIT - - -
> 5.166.124.28 :52152 [08/Aug/2020:21:02:27 +0300] "GET /720p_02815.ts
> HTTP/1.1" 200 616316 0.513 396688107 MISS 0.000 0.009 616032
> _______________________________________________
> nginx-ru mailing list
> nginx-ru на nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx-ru
----------- следущая часть -----------
Вложение в формате HTML было извлечено…
URL: <http://mailman.nginx.org/pipermail/nginx-ru/attachments/20200810/f7f1a833/attachment-0001.htm>
Подробная информация о списке рассылки nginx-ru