An analysis of silk density in spider webs
Data files
May 14, 2025 version files 42.11 GB
-
_013_255_2024-10-05_03-18-53.mp4
941.38 MB
-
_014(!005)_255_2024-10-10_06-44-38.mp4
703.99 MB
-
_015_255_2024-10-08_04-46-18.mp4
689.21 MB
-
_016_255_2024-10-08_05-17-46.mp4
678.48 MB
-
_017_255_2024-10-08_05-43-54.mp4
700.37 MB
-
_018_255_2024-10-18_04-31-07.mp4
647.01 MB
-
_019_255_2024-10-17_22-05-50.mp4
637.13 MB
-
_020_255_2024-10-19_15-36-41.mp4
700.14 MB
-
_021_255_2024-10-20_02-20-12.mp4
664.72 MB
-
_022(!006)_255_2024-10-20_03-45-37.mp4
683 MB
-
_023_255_2024-10-26_20-16-38.mp4
954.01 MB
-
_024_255_2024-10-30_04-10-19.mp4
1.08 GB
-
_025_255_2024-10-30_05-33-01.mp4
1.14 GB
-
_026_255_2024-11-02_16-15-44.mp4
980.19 MB
-
_027_255_2024-11-02_17-11-00.mp4
990.83 MB
-
_028_255_2024-11-02_18-44-50.mp4
974.47 MB
-
_029_255_2024-11-05_04-44-38.mp4
955.08 MB
-
_030_255_2024-11-07_22-02-20.mp4
936.61 MB
-
_031_255_2024-11-07_23-54-31.mp4
974.77 MB
-
_032_255_2024-11-08_04-05-31.mp4
987.42 MB
-
_033_255_2024-11-09_18-48-38.mp4
912.60 MB
-
_034_255_2024-11-12_04-58-39.mp4
944.38 MB
-
_035_255_2024-11-12_06-01-06.mp4
951.55 MB
-
_036_255_2024-11-12_22-10-38.mp4
960.14 MB
-
_037_255_2024-11-14_00-23-35.mp4
938.79 MB
-
_038_255_2024-11-14_01-04-59.mp4
960.60 MB
-
_039_255_2024-11-14_04-36-34.mp4
947.92 MB
-
_040_255_2024-11-14_05-34-00.mp4
1 GB
-
_041_255_2024-11-16_19-12-55.mp4
928 MB
-
_042_255_2024-11-16_20-21-32.mp4
596.44 MB
-
_043_255_2024-11-17_00-36-56.mp4
938.65 MB
-
_044_255_2024-11-19_03-16-53.mp4
953.58 MB
-
_045_255_2024-11-21_05-43-29.mp4
939.77 MB
-
_046_255_2024-11-25_19-25-56.mp4
707.44 MB
-
_047_255_2024-11-25_20-44-12.mp4
692.80 MB
-
_048_255_2024-11-25_21-33-22.mp4
741.12 MB
-
_049_255_2024-11-28_13-30-55.mp4
699.60 MB
-
_050_255_2024-11-28_14-17-29.mp4
726.57 MB
-
_051_255_2024-11-29_15-42-41.mp4
696.09 MB
-
_052_255_2024-12-01_14-08-30.mp4
699.79 MB
-
_053_255_2024-12-01_15-02-37.mp4
683.08 MB
-
_054_255_2024-12-01_15-54-16.mp4
706.43 MB
-
_055_255_2024-12-01_18-10-53.mp4
684.86 MB
-
_056_255_2024-12-02_23-26-35.mp4
668.12 MB
-
_057_255_2024-12-04_23-54-51.mp4
660.73 MB
-
_058_255_2024-12-05_04-26-14.mp4
679.31 MB
-
_059_255_2024-12-05_04-50-27.mp4
681.68 MB
-
_060_255_2024-12-05_12-45-49.mp4
687.20 MB
-
_061_255_2024-12-05_13-00-48.mp4
687.97 MB
-
_062_255_2024-12-05_13-12-57.mp4
684.22 MB
-
_063_255_2024-12-09_22-20-57.mp4
672.01 MB
-
_064_255_2024-12-10_17-49-41.mp4
664.01 MB
-
distance_records.zip
147.09 KB
-
README.md
2.54 KB
Abstract
This study explores the structural complexity of spider webs through information-theoretic and harmonicity-based frameworks to quantify spatial patterns in silk density across different web regions and reveal the underlying resource allocation strategies. By analyzing the entropy of silk density distributions across different species, we observed that the entropy values follow a normal distribution with a mean of 1.24 bits and a standard deviation of 0.22 bits when using 10 quantization levels. In the second part of the paper, by measuring the harmonicity of the silk density, we reveal that the silk density at a given point can be inferred from its neighbors, with an average harmonicity value of 0.0039 (fraction of total points in point cloud data). The harmonic behavior is notable for its maximum principle, suggesting that the strongest parts of the web appear at the boundaries, aligning with existing knowledge of spider web construction. These findings provide a new technique for quantifying web-building strategies and offer new insights into spider behavior and evolution.
This collection comprises high-resolution video scans of spider webs recorded under controlled laser illumination, paired with synchronized distance sensor measurements. Each web was grown in a fixed arena and periodically scanned by sweeping a laser sheet across its plane; the resulting video captures the laser line intersecting the silk strands. The accompanying CSV files record the raw distance readings from the sensor, which can be mapped back onto the video timestamps after appropriate post-processing. These data support quantitative studies of web geometry, silk deposition dynamics, and the temporal evolution of web-building behavior.
Description of the data and file structure
All scans are provided in pairs of files, one video and one sensor log:
\_(sample-number)_(light-level)_(date-of-scan)_(time-of-scan).mp4
\_(sample-number) (light-level) distance_data (date-of-scan) (time-of-scan).csv (included in distance_records.zip)
- sample-number: Unique integer identifier for each spider/web.
- light-level: Integer 0–255 indicating laser brightness; only level 255 (maximum detail) is provided.
- date-of-scan: ISO format
YYYY-MM-DD. - time-of-scan: 24-hour format
HH-MM-SS.
Video files
- Format: MP4, 1920×1080 or 1280×720 pixels at 30 fps.
- Content: Laser line sweeping across the web; silk strands appear as bright ridges.
CSV files
Each CSV has one row per sensor reading with two columns:
| Column | Type | Description |
|---|---|---|
| Time | Float | Timestamp in seconds since CSV recording started. |
| Distance | Float | Distance in meters from the sensor to the laser sheet. |
Sharing/Access information
- Primary access: Dryad repository at https://doi.org/10.5061/dryad.tqjq2bw99
- Derived from: Original experiments conducted in the GeoDes Lab under Dr. Norman Sheu, University of California, Berkeley.
Code/Software
We provide scripts to process these scans:
- Repository: https://github.com/normansheu/spiderweb
- Scripts:
pcd_generation_improved.py: Takes a video-csv pair and outputs the PCD representation of the spiderweb scan.
Collected spiders were kept in small containers for 1-2 weeks without food prior to introduction to experimental space to ensure relative uniformity of physiological state. Specimens were placed inside 10.16 x 10.16 x 10.16 cm (4” x 4” x 4”) acrylic boxes with clear sides, a black base, and no lid. Vaseline was coated on the inside top 2.54 cm (1”)of each side to prevent specimens from escaping. Each spider was given 1-2 weeks in ambient conditions to complete a web. Linyphiids construct webs over the course of multiple days and weeks, and web completion was defined as the point at which no additional silk was added to the web after several consecutive days.
Completed webs were placed into an enclosed experimental scanning apparatus blocking all outside light. Scanning was conducted by a laser (Quarton Inc. VLM-520-56) and camera (Canon EOS R5C mirrorless camera using a Canon RF 100mm F 2.8 Macro lens) mounted on a track at a fixed distance (0.67 meter). A small motor (Habow Technic Power-Functions XL-Motor-Set 8882) was used to advance the laser and camera simultaneously to scan the length of the experimental chamber from front to back, recording at 120 FPS for 20-30 seconds. An infrared laser distance sensor (DFROBOT DFRduin Uno v3.0[R3]) monitored the location of the camera relative to its start position to provide z-axis information for 3D reconstruction.
Individual video frames representing two dimensional slices of the web were extracted for cleaning and analysis using a custom Python script (Github Repository). For each video, a set cropped region was identified in each frame that excluded the box edges and background and accounted for any minute changes in elevation across the length of the box. Red and blue color values were reset to the minimum value and the image converted to grayscale. Background noise was removed using a minimum threshold filter of 0.55 max RGB value. Three-dimensional Point Cloud Data (PCD) representations of each web were created using the filtered data.
