# 📰 News & Research Tools Summary
**Last Updated:** April 13, 2026  
**Total Active Tools:** 8

---

## ✅ INSTALLED TOOLS (Active)

### 1. **newsdata.io API Integration** ⭐ NEW
- **Status:** Configured (API Key saved)
- **Endpoint:** `https://api.newsdata.io/v1/`
- **Rate Limit:** Depends on subscription tier
- **Available Endpoints:**
  - `/latest` - Real-time breaking news
  - `/topstories` - Trending stories by category
  - `/search` - Full-text search across archives
  - `/sources` - Available publishers
- **Parameters:** country, language, categories, keyword filters
- **Note:** Network test shows DNS resolution issue in current environment
- **Test Script:** `/root/.openclaw/workspace/scripts/newsdata.sh`

### 2. **hacker-news-surfer** 
- **Status:** ✅ Installed
- **Provider:** Public Hacker News API
- **Free:** Yes (no API key needed)
- **Features:**
  - Get top/best/new stories
  - Search AI topics
  - Story details & comments
  - User profiles
- **URL:** `https://news.ycombinator.com/`
- **Use Case:** Tech/AI industry news, developer community trends

### 3. **osint-investigator**
- **Status:** ✅ Installed
- **Type:** OSINT investigation platform
- **Capabilities:**
  - Social media research
  - Email validation
  - Username enumeration
  - Profile aggregation
- **Use Case:** Deep-dive investigations on individuals/companies
- **Reference:** `/root/.openclaw/workspace/skills/osint-investigator/SKILL.md`

### 4. **social-intelligence (xpoz.ai)**
- **Status:** ✅ Installed (requires OAuth setup)
- **Backend:** MCP server at `mcp.xpoz.ai`
- **Platforms:** Twitter, Instagram, Reddit, TikTok
- **Database:** 1.5B+ posts indexed
- **Features:**
  - Search posts by keywords
  - Sentiment analysis
  - Influencer discovery
  - Lead generation
  - Brand monitoring
- **Setup Required:** Run `xpoz-setup` skill for authentication
- **Export:** CSV up to 64K rows per query
- **Cost:** Free tier available ($20/mo for full access)

### 5. **stealth-browser**
- **Status:** ✅ Installed
- **Purpose:** Browse websites anonymously
- **Features:**
  - Headless browser automation
  - JavaScript execution
  - Screenshot capture
  - Cookie handling
- **Use Case:** Access dynamic content, login-protected areas, verify website functionality

### 6. **agent-browser-clawdbot**
- **Status:** ✅ Installed
- **Purpose:** Browser-based agent with database
- **Integration:** Works with stealth-browser
- **Use Case:** Complex browsing workflows with persistent state

### 7. **web-vulnerability-assessment**
- **Status:** ✅ Installed
- **Focus:** Security scanning
- **Compatible With:** Security tools (nmap, nuclei, sqlmap, etc.)
- **Use Case:** Assess website security posture
- **Output:** HTML reports with visual design

---

## 📊 NEWS & RESEARCH CAPABILITIES MATRIX

| Tool | Breaking News | Archives Search | Social Media | Analytics | Export | Language Support |
|------|--------------|-----------------|--------------|-----------|--------|------------------|
| newsdata.io API | ✅ Real-time | ✅ Archive | ❌ | Basic | ✅ CSV | Indonesian, English + 50+ |
| hacker-news | ✅ Real-time | ✅ Recent | ❌ | Score-based | ✅ JSON | English only |
| osint-investigator | ❌ | ✅ Deep | ✅ Multi-platform | ✅ Profiles | ✅ Reports | Global |
| social-intelligence | ✅ Real-time | ✅ 1.5B+ | ✅ 4 platforms | ✅ Advanced | ✅ CSV | Multi-platform |
| stealth-browser | ✅ Live | ✅ Manual | ✅ Interactive | ❌ | ✅ Screenshots | All websites |
| agent-browser | ✅ Live | ✅ Persistent | ✅ Stateful | ❌ | ✅ Logs | All websites |
| web-security | ⚠️ Security focus | ⚠️ Vulnerabilities | ❌ | ✅ Risk scores | ✅ HTML | All regions |
| **chart-image** | ❌ | ❌ | ❌ | ✅ Chart gen | ✅ PNG/SVG | N/A (data input)

---

## 🎯 USE CASE EXAMPLES

### Daily Indonesia Brief
```bash
# Use newsdata.io API (when network resolves):
curl "https://api.newsdata.io/v1/latest?apikey=$KEY&country=ID&language=id"

# Alternative with web scraping:
stealth-browser visit https://kompas.com
```

### Competitor Monitoring
```bash
# Track mentions across platforms:
mcporter call xpoz.getTwitterPostsByKeywords query="Bangunindo Teknusa"
osint-investigator track_company "Bangunindo Teknusa Jaya"
```

### Executive Intelligence
```bash
# Build profile on target person:
osint-investigate "Denny Basri" --all-platforms
social-intelligence find_experts topic="technology CEO" location="Jakarta"
```

### Technical News Tracking
```bash
# Monitor Hacker News for AI/tech trends:
hacker-news-top --filter ai,machine learning,LLM

# Set up automated alerts:
watch -n 300 'hacker-news-search "AI startup funding"'
```

---

## 🔑 CONFIGURED CREDENTIALS

### News Data API (✅ Active)
```env
NEWSDATA_API_KEY="pub_65515da7021a456ebfdd4bd97ce23cf0"
Location: /root/.openclaw/workspace/.env
Status: Saved but network test failed (DNS issue)
```

### Xpoz Account (⏳ Pending Setup)
```
Auth Type: OAuth 2.1 via xpoz-setup skill
Status: Not yet configured
Required: Visit xpoz.ai for free account creation
```

---

## ⚡ QUICK START COMMANDS

### Test News API Connection
```bash
export NEWSDATA_API_KEY="pub_65515da7021a456ebfdd4bd97ce23cf0"
./scripts/newsdata.sh latest country=ID language=id
```

### Check Hacker News Status
```bash
curl -s "https://hacker-news.firebaseio.com/v0/topstories.json" | jq '.[:5]'
```

### List Available Xpoz Tools
```bash
mcporter list xpoz
```

### Test Stealth Browser
```bash
stealth-browser visit "https://www.google.co.id" screenshot=true
```

### Test Chart Generator
```bash
# Simple line chart
node /root/.openclaw/workspace/skills/chart-image/scripts/chart.mjs \
  --type line \
  --data '[{"x":"Jan","y":25},{"x":"Feb","y":31},{"x":"Mar","y":28}]' \
  --title "Inflasi Indonesia Q1 2026" \
  --output chart.png

# Bar chart
node /root/.openclaw/workspace/skills/chart-image/scripts/chart.mjs \
  --type bar \
  --data '[{"x":"Antara","y":85},{"x":"Detik","y":94}]' \
  --title "Portal News Traffic" \
  --output portal.png

# Donut chart
node /root/.openclaw/workspace/skills/chart-image/scripts/chart.mjs \
  --type donut \
  --data '[{"category":"Economy","value":45},{"category":"Politics","value":30}]' \
  --title "News Category Split" \
  --output categories.png
```

---

## 📈 COST SUMMARY

| Tool | Monthly Cost | API Usage Limits |
|------|-------------|------------------|
| newsdata.io API | Free-$20 (depends on plan) | Varies by tier |
| hacker-news | FREE | No limits |
| osint-investigator | FREE/Open-source | Unlimited |
| social-intelligence | Free-$20/month | Rate-limited on free tier |
| stealth-browser | FREE (local) | Local resource limits |
| agent-browser | FREE | Local resources |
| web-security | FREE | Customizable |

### 8. **chart-image** ⭐ NEW
- **Status:** ✅ Installed + Configured (npm dependencies ready)
- **Type:** Publication-quality chart/image generator
- **Backend:** Vega-Lite + Sharp (Node.js, no browser needed)
- **Features:**
  - Line, bar, area, point, histogram, candlestick, pie/donut, heatmap charts
  - Multi-series comparisons & stacked bars
  - Dual-axis volume overlays
  - Sparklines for inline visualizations
  - Alert-style charts with annotations
  - Social media size presets (Twitter, Instagram, LinkedIn, etc.)
  - Dark/light theme auto-switching
  - Y-axis formatting (dollar, percent, compact, crypto, etc.)
- **Output:** PNG or SVG images
- **Performance:** <500ms cold start, ~15MB total size
- **Use Case:** Data visualization for reports, dashboards, social media posts
- **Test Charts Created:** `/tmp/test-chart.png`, `/tmp/news-portal.png`, `/tmp/news-categories.png`, `/tmp/ihsg-chart.png`
- **Cost:** FREE (local processing)

---

## 🚨 KNOWN ISSUES

| Issue | Impact | Workaround |
|-------|--------|------------|
| newsdata.io DNS resolution fails | Cannot fetch news via API | Use alternative sources or wait for network fix |
| xpoz requires OAuth setup | Cannot access social intelligence features | Complete initial setup |
| hacker-news English-only | Limited non-English content | Supplement with other sources |

---

## 📞 NEXT STEPS

1. **Fix network connectivity** for newsdata.io API (contact OpenClaw support)
2. **Complete xpoz OAuth setup** for social intelligence features
3. **Create daily briefing script** combining multiple sources
4. **Set up automated monitoring** for target keywords/companies

---

*This document auto-updates as new tools are installed*
