Pipelined Apache HTTP Server

Unmodified Worker timings on quad core

2008-05-05T21:58:00.000-07:00

./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   5.469071 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29302930 bytes
HTML transferred:       4400440 bytes
Requests per second:    18284.64 [#/sec] (mean)
Time per request:       5.469 [ms] (mean)
Time per request:       0.055 [ms] (mean, across all concurrent requests)
Transfer rate:          5232.33 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   1.0      2       4
Processing:     1    3   1.9      3      55
Waiting:        0    1   1.1      2      28
Total:          2    4   2.1      5      57
WARNING: The median and mean for the initial connection time are not within a normal deviation
        These results are probably not that reliable.

Percentage of the requests served within a certain time (ms)
  50%      5
  66%      5
  75%      5
  80%      5
  90%      6
  95%      6
  98%      6
  99%      7
 100%     57 (longest request)

Preparation pool,6 Threads Per Child, Pipelined Worker w/ 2 Handlers Timings on quad core

2008-04-25T16:19:00.000-07:00

This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   5.590920 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300000 bytes
HTML transferred:       4400000 bytes
Requests per second:    17886.14 [#/sec] (mean)
Time per request:       5.591 [ms] (mean)
Time per request:       0.056 [ms] (mean, across all concurrent requests)
Transfer rate:          5117.76 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       1
Processing:     1    5   0.4      5       8
Waiting:        1    5   0.5      5       8
Total:          2    5   0.4      5       8

Percentage of the requests served within a certain time (ms)
  50%      5
  66%      5
  75%      5
  80%      5
  90%      6
  95%      6
  98%      6
  99%      6
 100%      8 (longest request)

Preparation pool,4 Threads Per Child, Pipelined Worker w/ 2 Handlers Timings on dvorak 100K

2008-03-16T16:04:00.000-07:00

./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   195.287954 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300000 bytes
HTML transferred:       4400000 bytes
Requests per second:    512.06 [#/sec] (mean)
Time per request:       195.288 [ms] (mean)
Time per request:       1.953 [ms] (mean, across all concurrent requests)
Transfer rate:          146.52 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0      18
Processing:    14  194  14.5    195     243
Waiting:       13  192  14.4    193     241
Total:         14  194  14.4    195     243

Percentage of the requests served within a certain time (ms)
  50%    195
  66%    201
  75%    204
  80%    206
  90%    213
  95%    217
  98%    222
  99%    226
 100%    243 (longest request)

Preparation pool, 4 Threads Per Child, Pipelined Worker w/ 2 Handlers Timings

2008-03-16T14:19:00.000-07:00

./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests

Server Software: Apache/2.2.4
Server Hostname: localhost
Server Port: 8080

Document Path: /index.html
Document Length: 44 bytes

Concurrency Level: 100
Time taken for tests: 12.214281 seconds
Complete requests: 100000
Failed requests: 0
Write errors: 0
Total transferred: 28900289 bytes
HTML transferred: 4400044 bytes
Requests per second: 8187.14 [#/sec] (mean)
Time per request: 12.214 [ms] (mean)
Time per request: 0.122 [ms] (mean, across all concurrent requests)
Transfer rate: 2310.57 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.1 0 2
Processing: 3 11 1.4 12 23
Waiting: 2 11 1.2 11 23
Total: 5 11 1.4 12 23

Percentage of the requests served within a certain time (ms)
50% 12
66% 12
75% 12
80% 13
90% 13
95% 14
98% 14
99% 15
100% 23 (longest request)

4 Threads Per Child, Pipelined Worker w/ 2 Handlers Timings on dvorak 100K

2008-03-13T20:26:00.000-07:00

./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   194.179164 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300000 bytes
HTML transferred:       4400000 bytes
Requests per second:    514.99 [#/sec] (mean)
Time per request:       194.179 [ms] (mean)
Time per request:       1.942 [ms] (mean, across all concurrent requests)
Transfer rate:          147.35 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0      12
Processing:    15  193  42.3    192    1080
Waiting:       14  192  42.2    191    1079
Total:         15  193  42.3    192    1080

Percentage of the requests served within a certain time (ms)
  50%    192
  66%    197
  75%    201
  80%    203
  90%    208
  95%    214
  98%    221
  99%    226
 100%   1080 (longest request)

Default Worker Timings on dvorak 100K Requests

2008-03-13T19:50:00.001-07:00

./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   37.61969 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29301465 bytes
HTML transferred:       4400220 bytes
Requests per second:    2698.18 [#/sec] (mean)
Time per request:       37.062 [ms] (mean)
Time per request:       0.371 [ms] (mean, across all concurrent requests)
Transfer rate:          772.06 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   3.8      0      37
Processing:     0   34  25.7     30     547
Waiting:        0   25  22.0     20     509
Total:          0   36  25.8     32     547

Percentage of the requests served within a certain time (ms)
  50%     32
  66%     41
  75%     48
  80%     53
  90%     68
  95%     84
  98%    106
  99%    121
 100%    547 (longest request)

Pipelined Worker w/ 2 Handlers Timings

2008-02-25T22:07:00.000-08:00

$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   17.654297 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28900000 bytes
HTML transferred:       4400000 bytes
Requests per second:    5664.34 [#/sec] (mean)
Time per request:       17.654 [ms] (mean)
Time per request:       0.177 [ms] (mean, across all concurrent requests)
Transfer rate:          1598.59 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0       7
Processing:     3   17   2.3     17      49
Waiting:        2   16   2.4     16      49
Total:          5   17   2.3     17      49

Percentage of the requests served within a certain time (ms)
  50%     17
  66%     18
  75%     18
  80%     19
  90%     20
  95%     21
  98%     23
  99%     25
 100%     49 (longest request)

Pipelined Worker Timings

2008-02-25T21:22:00.000-08:00

$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   22.330702 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28900000 bytes
HTML transferred:       4400000 bytes
Requests per second:    4478.14 [#/sec] (mean)
Time per request:       22.331 [ms] (mean)
Time per request:       0.223 [ms] (mean, across all concurrent requests)
Transfer rate:          1263.82 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0       5
Processing:    12   21  42.0     18     963
Waiting:       11   21  42.0     17     963
Total:         12   21  42.0     18     963

Percentage of the requests served within a certain time (ms)
  50%     18
  66%     19
  75%     21
  80%     22
  90%     27
  95%     34
  98%     45
  99%     54
 100%    963 (longest request)

Server limits

2008-01-31T19:58:00.001-08:00

Set this in plapache2/conf/extra/httpd-mpm.conf:

<IfModule mpm_prefork_module>
    StartServers          1
    MinSpareServers       1
    MaxSpareServers       1
    MaxClients            1
    MaxRequestsPerChild   0
    ServerLimit           1
</IfModule>

Uncomment this in plapache2/conf/httpd.conf
#Include conf/extra/httpd-mpm.conf

Timings by Phase on dvorak

2008-01-21T22:24:00.001-08:00

h secs=10 nsecs=177964398
p secs=6 nsecs=682820996
r secs=9 nsecs=811368345
s secs=5 nsecs=551042645
T secs=32 nsecs=223196384

Prefork Timings on dvorak

2008-01-20T23:42:00.000-08:00

$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   62.52683 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28800864 bytes
HTML transferred:       4400132 bytes
Requests per second:    1611.53 [#/sec] (mean)
Time per request:       62.053 [ms] (mean)
Time per request:       0.621 [ms] (mean, across all concurrent requests)
Transfer rate:          453.24 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    8   7.6      7      69
Processing:     9   52  16.4     52     146
Waiting:        0   28  12.8     25     118
Total:         15   61  19.3     60     177

Percentage of the requests served within a certain time (ms)
  50%     60
  66%     71
  75%     76
  80%     79
  90%     87
  95%     93
  98%    100
  99%    104
 100%    177 (longest request)

Pipelined Timings on dvorak

2008-01-20T23:13:00.000-08:00


$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   138.887738 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28800576 bytes
HTML transferred:       4400088 bytes
Requests per second:    720.01 [#/sec] (mean)
Time per request:       138.888 [ms] (mean)
Time per request:       1.389 [ms] (mean, across all concurrent requests)
Transfer rate:          202.50 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   23  22.2     17     208
Processing:     6  110  47.4    102    1457
Waiting:        1   59  40.4     51    1457
Total:          8  133  51.7    125    1457

Percentage of the requests served within a certain time (ms)
  50%    125
  66%    147
  75%    162
  80%    171
  90%    198
  95%    223
  98%    258
  99%    282
 100%   1457 (longest request)

Makefile

2008-01-20T23:03:00.001-08:00

In the server directory's Makefile,
under LTLIBRARY_SOURCES, added pipeline.c

Pipelined Timings

2008-01-20T21:04:00.000-08:00

$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   27.188178 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28900000 bytes
HTML transferred:       4400000 bytes
Requests per second:    3678.07 [#/sec] (mean)
Time per request:       27.188 [ms] (mean)
Time per request:       0.272 [ms] (mean, across all concurrent requests)
Transfer rate:          1038.02 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   1.0      0      18
Processing:     0   26  33.0     17     628
Waiting:        0   25  33.0     16     628
Total:          0   26  33.0     18     628

Percentage of the requests served within a certain time (ms)
  50%     18
  66%     23
  75%     28
  80%     35
  90%     69
  95%     93
  98%    122
  99%    150
 100%    628 (longest request)

Prefork benchmark

2008-01-20T20:34:00.001-08:00

$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   15.629945 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28914450 bytes
HTML transferred:       4402200 bytes
Requests per second:    6397.98 [#/sec] (mean)
Time per request:       15.630 [ms] (mean)
Time per request:       0.156 [ms] (mean, across all concurrent requests)
Transfer rate:          1806.53 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    4   3.3      6      23
Processing:     5   10   3.7     10      88
Waiting:        1    8   3.8      8      87
Total:          8   15   3.3     15      88

Percentage of the requests served within a certain time (ms)
  50%     15
  66%     16
  75%     16
  80%     17
  90%     18
  95%     19
  98%     21
  99%     22
 100%     88 (longest request)

Pipelined Timings by Phase

2008-01-20T20:30:00.000-08:00

h secs=3 nsecs=938123674
p secs=5 nsecs=14353627
r secs=3 nsecs=853008646
s secs=0 nsecs=248275943
T secs=13 nsecs=53761890

Fixed segfaults (debug statements)

2007-12-08T13:48:00.000-08:00

Turned out debug statements were causing segfaults. This occurs probably because the servers exiting and cleaning resources needed by the debug statements.

Here are the results:


$ ./ab -n 100000 -c 100 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      100
Time taken for tests:   19.453643 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      28900000 bytes
HTML transferred:       4400000 bytes
Requests per second:    5140.43 [#/sec] (mean)
Time per request:       19.454 [ms] (mean)
Time per request:       0.195 [ms] (mean, across all concurrent requests)
Transfer rate:          1450.73 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0       4
Processing:     0   18  21.9     15     288
Waiting:        0   18  20.4     15     288
Total:          0   18  21.9     15     288

Percentage of the requests served within a certain time (ms)
  50%     15
  66%     21
  75%     28
  80%     31
  90%     41
  95%     60
  98%     75
  99%     94
 100%    288 (longest request)

Seg faults

2007-11-27T21:27:00.000-08:00

I'm not sure how to debug this one:

core was generated by `/home/kle/plapache2/bin/httpd -k start'.
Program terminated with signal 11, Segmentation fault.
#0 apr_brigade_writev (b=0x817e310, flush=0, ctx=0x0, vec=0x817e350, nvec=24)
at buckets/apr_brigade.c:478
/home/kle/plhttpd-2.2.4/srclib/apr-util/buckets/apr_brigade.c:478:14731:beg:0xb7ef5565
(gdb) bt
#0 apr_brigade_writev (b=0x817e310, flush=0, ctx=0x0, vec=0x817e350, nvec=24) at buckets/apr_brigade.c:478
#1 0x080956df in ap_http_header_filter (f=0x817d930, b=0x817e298) at http_filters.c:627
#2 0x0806e767 in ap_content_length_filter (f=0x817d918, b=0x817e298) at protocol.c:1338
#3 0x08096875 in ap_byterange_filter (f=0x817d900, bb=0x817e298) at byterange_filter.c:177
#4 0x080728cc in default_handler (r=0x817cba0) at core.c:3740
#5 0x0807a7a9 in ap_run_handler (r=0x817cba0) at config.c:157
#6 0x0807da37 in ap_invoke_handler (r=0x817cba0) at config.c:372
#7 0x080944f2 in ap_process_request (r=0x817cba0) at http_request.c:266
#8 0x080916cb in ap_process_http_connection (c=0x8170be8) at http_core.c:187
#9 0x08081a09 in ap_run_process_connection (c=0x8170be8) at connection.c:43
#10 0x080a7b6c in child_main (child_num_arg=) at prefork.c:652
#11 0x080a7ee7 in make_child (s=0x80d4c80, slot=2) at prefork.c:752
#12 0x080a7fa4 in startup_children (number_to_start=3) at prefork.c:770
#13 0x080a8b43 in ap_mpm_run (_pconf=0x80d00a8, plog=0x810e1a0, s=0x80d4c80) at prefork.c:998
#14 0x08066db5 in main (argc=135061792, argv=0x0) at main.c:717

apr_thread_exit

2007-06-19T23:37:00.000-07:00

This function destroys the thread's pool. This was causing Apache to crash because I was using the request's pool to create the preparation threads. I fixed this by creating a new pool for each thread.

Thread limit

2007-06-12T23:58:00.000-07:00

As I starting threading the preparation phase, where I spawn a new thread for each subrequest, Apache would bring my system to a crawl.

I suspected that something was going on with threads because that was the only thing different than the previous phases.

I used this program and modified it to see if there was a limit for each process.

Seems my computer has a limit of 32,332 threads per process tree.

I am thinking of trying a thread pool next.

Request Diagram

2007-06-05T21:10:00.000-07:00

Fixed crashes

2007-05-31T22:53:00.000-07:00

I accidentally initiated the threads and called their functions before initiating the queues.

For some reason, my debug statements weren't writing to the error log. It was actually because I was testing from the browser and I hit the go button instead of refresh so it didn't make a new request.

Here are the results:


~/apache2/bin$ ./apachectl start
~/apache2/bin$ !./ab
./ab -n 100000 -c 1000 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      1000
Time taken for tests:   21.20827 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29301465 bytes
HTML transferred:       4400220 bytes
Requests per second:    4757.19 [#/sec] (mean)
Time per request:       210.208 [ms] (mean)
Time per request:       0.210 [ms] (mean, across all concurrent requests)
Transfer rate:          1361.22 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   31 483.8      1   20999
Processing:     0   65 507.9     21   13177
Waiting:        0   55 507.4     17   13137
Total:         10   97 738.2     23   21003

Percentage of the requests served within a certain time (ms)
  50%     23
  66%     39
  75%     51
  80%     56
  90%     66
  95%     77
  98%     89
  99%   1078
 100%  21003 (longest request)

apr_pollset_poll

2007-05-30T23:44:00.000-07:00

Helpful link: text

apr_pollset_poll

APR_DECLARE(apr_status_t) apr_pollset_poll(apr_pollset_t *pollset,
                                           apr_interval_time_t timeout,
                                           apr_int32_t *num,
                                           const apr_pollfd_t **descriptors);

struct apr_pollset_t
{
    apr_pool_t *pool;
    apr_uint32_t nelts;
    apr_uint32_t nalloc;
    struct pollfd *pollset;
    apr_pollfd_t *query_set;
    apr_pollfd_t *result_set;
};

/** Used in apr_pollfd_t to determine what the apr_descriptor is */
typedef enum { 
    APR_NO_DESC,                /**< nothing here */
    APR_POLL_SOCKET,            /**< descriptor refers to a socket */
    APR_POLL_FILE,              /**< descriptor refers to a file */
    APR_POLL_LASTDESC           /**< descriptor is the last one in the list */
} apr_datatype_e ;

/** Union of either an APR file or socket. */
typedef union {
    apr_file_t *f;              /**< file */
    apr_socket_t *s;            /**< socket */
} apr_descriptor;

/** @see apr_pollfd_t */
typedef struct apr_pollfd_t apr_pollfd_t;

/** Poll descriptor set. */
struct apr_pollfd_t {
    apr_pool_t *p;              /**< associated pool */
    apr_datatype_e desc_type;   /**< descriptor type */
    apr_int16_t reqevents;      /**< requested events */
    apr_int16_t rtnevents;      /**< returned events */
    apr_descriptor desc;        /**< @see apr_descriptor */
    void *client_data;          /**< allows app to associate context */
};

Children crashing

2007-05-30T22:40:00.000-07:00

I tried threading the security phase but when I checked the log file, it shows that some children are seg faulting. I suspect that since my threads and queues are global variables in the parent, the children cannot access them. It might have worked before because the request parsing and security phases may have not been necessary. I am now looking through the prefork MPM code to see if there is anywhere else I can put the threads. Another option would be to have each child contain a list of threads and then pass the threads to thread function so that it knows which thread to go on to.

Threaded request_parsing_phase

2007-05-23T23:36:00.000-07:00


./ab -n 100000 -c 1000 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      1000
Time taken for tests:   16.873245 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300293 bytes
HTML transferred:       4400044 bytes
Requests per second:    5926.54 [#/sec] (mean)
Time per request:       168.732 [ms] (mean)
Time per request:       0.169 [ms] (mean, across all concurrent requests)
Transfer rate:          1695.76 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   32 439.6      1    9030
Processing:     0   57 330.8     23   13862
Waiting:        0   45 330.0     18   13861
Total:          8   90 638.5     24   16866

Percentage of the requests served within a certain time (ms)
  50%     24
  66%     40
  75%     56
  80%     60
  90%     71
  95%     79
  98%     89
  99%   1190
 100%  16866 (longest request)

Separated phases into functions

2007-05-22T23:18:00.000-07:00

Ran after separating into functions:


~/apache2/bin$ ./apachectl start
~/apache2/bin$ ./ab -n 100000 -c 1000 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      1000
Time taken for tests:   18.781482 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300000 bytes
HTML transferred:       4400000 bytes
Requests per second:    5324.39 [#/sec] (mean)
Time per request:       187.815 [ms] (mean)
Time per request:       0.188 [ms] (mean, across all concurrent requests)
Transfer rate:          1523.47 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   36 480.8      1    9030
Processing:     0   62 502.0     27   12897
Waiting:        0   51 501.7     16   12868
Total:          1   98 805.2     30   18333

Percentage of the requests served within a certain time (ms)
  50%     30
  66%     40
  75%     45
  80%     48
  90%     57
  95%     64
  98%     72
  99%    964
 100%  18333 (longest request)

Request Processing in Apache 2.0

2007-05-22T21:16:00.000-07:00

Request Parsing
Security
Preparation
Handler

Link: Request Processing in Apache 2.0

log to log/error_log

2007-05-17T00:22:00.001-07:00

#include "http_log.h"

ap_log_error(APLOG_MARK, int debug_level, 0, ap_server_conf, "%d pushing to queue_return", r);

#define APLOG_EMERG 0 /* system is unusable */
#define APLOG_ALERT 1 /* action must be taken immediately */
#define APLOG_CRIT 2 /* critical conditions */
#define APLOG_ERR 3 /* error conditions */
#define APLOG_WARNING 4 /* warning conditions */
#define APLOG_NOTICE 5 /* normal but significant condition */
#define APLOG_INFO 6 /* informational */
#define APLOG_DEBUG 7 /* debug-level messages */

Prefork single process benchmark

2007-05-16T22:24:00.000-07:00

~/apache2/bin$ ./httpd -X

In other window:

~/apache2/bin$ ./ab -n 100000 -c 1000 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
apr_socket_recv: Connection reset by peer (104)
Total of 10000 requests completed

Same results with

~/apache2/bin$ sudo ./httpd -X

Prefork benchmark

2007-05-16T22:21:00.000-07:00


~/apache2/bin$ ./apachectl start

~/apache2/bin$ ./ab -n 100000 -c 1000 localhost:8080/index.html
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking localhost (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software:        Apache/2.2.4
Server Hostname:        localhost
Server Port:            8080

Document Path:          /index.html
Document Length:        44 bytes

Concurrency Level:      1000
Time taken for tests:   19.266706 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      29300000 bytes
HTML transferred:       4400000 bytes
Requests per second:    5190.30 [#/sec] (mean)
Time per request:       192.667 [ms] (mean)
Time per request:       0.193 [ms] (mean, across all concurrent requests)
Transfer rate:          1485.10 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   27 400.9      1    9015
Processing:     0   58 424.8     20   13145
Waiting:        0   49 424.4     16   13118
Total:          9   86 660.4     20   14302

Percentage of the requests served within a certain time (ms)
  50%     20
  66%     38
  75%     45
  80%     48
  90%     56
  95%     63
  98%     72
  99%   1069
 100%  14302 (longest request)

ApacheBench

2007-05-09T21:44:00.000-07:00

~/apache2/bin$ ./ab -n 100000 -c 1000 localhost/index.html

Request Processing in Apache

2007-05-09T10:41:00.001-07:00

Link: Request Processing in Apache at ApacheTutor

Web Bench

2007-05-08T22:11:00.000-07:00

I found Web Bench.

make
./webbench http://localhost/index.html -c 8

-c|--clients Run HTTP clients at once. Default one.

MPM - Prefork

2007-05-08T20:55:00.000-07:00

Prefork

Pros

Avoid threadings for compatibility with non-thread-safe libraries
Isolates each request, so that a problem with a single request will not affect any other.

Apache HTTPD 2.2.4

2007-05-03T00:36:00.000-07:00

I downloaded a new version of Apache HTTPD (version 2.2.4).

Then I imported it into SVN:
svn import httpd-2.2.4 file:///home/kle/svn/httpd-2.2.4 -m "Initial import"

Deleted it:
rm -rf httpd-2.2.4

Then checked it out:
svn co file:///home/kle/svn/httpd-2.2.4

Flood

2007-05-02T22:32:00.000-07:00

Download flood

I got the following error running configure on an AMD64 system:

checking build system type... Invalid configuration`x86_64-unknown-linux-gnu': machine `x86_64-unknown' not recognized
configure: error: /bin/sh ./config.sub x86_64-unknown-linux-gnu failed

This seemed to fix it:
libtoolize --force
aclocal --force
automake --add-missing
autoconf
autoheader

Then I ran:
$ ./buildconf
$ ./configure --disable-sharing

I get the following error trying to compile it:
$ make all
/usr/share/apr-1.0/build/libtool --silent --mode=compile gcc -g -O2 -pipe -Wall -g -O2 -pthread -DLINUX=2 -D_REENTRANT -D_GNU_SOURCE -I/usr/include/apr-1.0 -I/usr/include/apr-1.0 -I/usr/include/postgresql -I. -c flood.c && touch flood.lo
libtool: compile: unable to infer tagged configuration
libtool: compile: specify a tag with `--tag'
make: *** [flood.lo] Error 1