Add documentation test report from alpha environment dogfooding
This commit is contained in:
parent
a223bcb27a
commit
c06c7551d8
1 changed files with 147 additions and 0 deletions
147
docs/DOCUMENTATION_TEST_REPORT.md
Normal file
147
docs/DOCUMENTATION_TEST_REPORT.md
Normal file
|
|
@ -0,0 +1,147 @@
|
||||||
|
# Documentation Test Report - Alpha Environment
|
||||||
|
**Date:** 2026-04-19
|
||||||
|
**Tester:** BarnacleBoy
|
||||||
|
**Environment:** alpha
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Executive Summary
|
||||||
|
|
||||||
|
Most wrapper functions work correctly. Several wrappers hit API server errors (500/502) which suggests alpha API endpoints are not fully operational for social operations (follow, trust, react, update).
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Test Results
|
||||||
|
|
||||||
|
### Working Wrappers
|
||||||
|
|
||||||
|
| Wrapper | Status | Notes |
|
||||||
|
|---------|--------|-------|
|
||||||
|
| `create_post` | ✅ Working | Verified - post created with Spongebob quotes |
|
||||||
|
| `create_comment` | ✅ Working | Verified - comments attach to posts correctly |
|
||||||
|
|
||||||
|
### Wrappers with API Errors
|
||||||
|
|
||||||
|
| Wrapper | Status | Error | Notes |
|
||||||
|
|---------|--------|-------|-------|
|
||||||
|
| `follow` | ❌ Error | 502 Bad Gateway | Endpoint `/alpha/relfollow` returns学师 Bad Gateway |
|
||||||
|
| `react` | ❌ Error | 500 Internal Server Error | Endpoint `/alpha/reacttosomething` returns 500 |
|
||||||
|
| `trust` | ❌ Error | 500 Internal Server Error | Endpoint `/alpha/reltrust` returns 500 |
|
||||||
|
| `update_post` | ❌ Error | 500 Internal Server Error | Endpoint `/alpha/post/update` returns 500 |
|
||||||
|
|
||||||
|
### Wrappers with Unclear Behavior
|
||||||
|
|
||||||
|
| Wrapper | Status | Notes |
|
||||||
|
|---------|--------|-------|
|
||||||
|
| `votecast` | ⚠️ Unclear | Returns empty dict `{}` - no error thrown but no data returned |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Static Documentation Issues Found
|
||||||
|
|
||||||
|
### 1. APIClient.wrapped() Docstring (Code Bug)
|
||||||
|
|
||||||
|
**File:** `src/trustcafeapiwrapper/apiclient.py` lines 207, 209
|
||||||
|
|
||||||
|
**Issue:** Docstring says `'job'` but code reads `"job_function"`
|
||||||
|
|
||||||
|
```python
|
||||||
|
# Docstring says (incorrect):
|
||||||
|
wrapped_data (dict): A dictionary with 'job' (string) and 'payload' (dict) keys.
|
||||||
|
|
||||||
|
# But code reads:
|
||||||
|
return self.run_job(wrapped_data.get("job_function"), wrapped_data.get("payload", {}))
|
||||||
|
```
|
||||||
|
|
||||||
|
**Impact:** Low - all wrapper functions return `{"job_function": ..., "payload": ...}` which matches what `wrapped()` reads. Only the docstring is misleading.
|
||||||
|
|
||||||
|
**Proposed Fix (code):** Update docstring:
|
||||||
|
```python
|
||||||
|
wrapped_data (dict): A dictionary with 'job_function' (string) and 'payload' (dict) keys.
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
### 2. update_post wrapper docstring (Code Bug)
|
||||||
|
|
||||||
|
**File:** `src/trustcafeapiwrapper/wrappers/post/update_post.py` line 16
|
||||||
|
|
||||||
|
**Issue:** Internal docstring references `post_slug` but parameter is `post_path`
|
||||||
|
|
||||||
|
```python
|
||||||
|
def update_post(
|
||||||
|
post_text:str,
|
||||||
|
post_path:str|None=None, # Parameter is post_path
|
||||||
|
...
|
||||||
|
):
|
||||||
|
"""
|
||||||
|
Args:
|
||||||
|
post_slug (str): The slug of the post to update. # Docstring says post_slug - WRONG
|
||||||
|
"""
|
||||||
|
```
|
||||||
|
|
||||||
|
**Impact:** Low - parameter names in function signature are correct. Only internal docstring is wrong.
|
||||||
|
|
||||||
|
**Proposed Fix (code):**
|
||||||
|
```python
|
||||||
|
post_path (str, optional): The path of the post to update.
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
### 3. feed.followingfeed vs feed.following (Documentation Bug)
|
||||||
|
|
||||||
|
**File:** `docs/API_REFERENCE.md` line 688
|
||||||
|
|
||||||
|
**Issue:** Documents `feed.followingfeed()` but actual job function is `feed.following`
|
||||||
|
|
||||||
|
```python
|
||||||
|
# Documentation says:
|
||||||
|
feed = API.run_job('feed.followingfeed')
|
||||||
|
|
||||||
|
# But actual job is:
|
||||||
|
feed = API.run_job('feed.following')
|
||||||
|
```
|
||||||
|
|
||||||
|
**Impact:** Medium - user will get AttributeError trying to use undocumented job name.
|
||||||
|
|
||||||
|
**Proposed Fix (docs):** Update line 688 from:
|
||||||
|
```markdown
|
||||||
|
### feed.followingfeed()
|
||||||
|
```
|
||||||
|
to:
|
||||||
|
```markdown
|
||||||
|
### feed.following()
|
||||||
|
```
|
||||||
|
|
||||||
|
And update example from:
|
||||||
|
```python
|
||||||
|
following_feed = API.run_job('feed.followingfeed')
|
||||||
|
```
|
||||||
|
to:
|
||||||
|
```python
|
||||||
|
following_feed = API.run_job('feed.following')
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Recommendations
|
||||||
|
|
||||||
|
1. **For Alpha API:** Several social operations (follow, trust, react, update_post) are returning 500 errors. These need backend fixes before wrappers can be verified working.
|
||||||
|
|
||||||
|
2. **For Documentation:** Fix the three static issues above to match code reality.
|
||||||
|
|
||||||
|
3. **For votecast:** Verify if empty dict return is expected behavior or if there's a response that should be returned.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Test Assets Created
|
||||||
|
|
||||||
|
Five Spongebob-themed posts created for testing:
|
||||||
|
1. "I wumbo, you wumbo, he wumbo, we wumbo!"
|
||||||
|
2. "The best time to wear a sweater is all the time."
|
||||||
|
3. "I'm a Goofy Goober, yeah!"
|
||||||
|
4. "Life is fun. But fun is different."
|
||||||
|
5. "Patrick, you in danger, homie."
|
||||||
|
|
||||||
|
Post IDs saved to `/home/agent/trustcafe-test-posts.json`
|
||||||
Loading…
Add table
Add a link
Reference in a new issue