# ArcGIS Server — DEV11 (ArcGIS Base Development)

**Terakhir diaudit:** 6 Jul 2026 12:36 WIB  
**Host:** `10.100.1.51` (DEV11) · **Versi:** ArcGIS Server 12.0.58905  
**URL publik:** `https://dev.gisportal.id/server`

## Akses

```text
ssh dev51-base
ArcGIS Server Manager : https://dev.gisportal.id/server/admin
REST Services Directory: https://dev.gisportal.id/server/rest/services
```

---

## Status Saat Audit (6 Jul 2026)

| Item | Status |
|------|--------|
| Windows Service `ArcGIS Server` | ✅ Running (Auto) |
| ArcGIS Server internal port `6099` | ✅ Listening |
| Web Adaptor HTTPS internal `6443` | ✅ Listening (javaw) |
| IIS App Pool `ArcGISWebAdaptorAppPoolserver` | ✅ Started |
| REST publik (Herewego sample) | ✅ HTTP 200 |
| Uptime server | ⚠️ **Baru reboot** 06 Jul 2026 11:09 WIB (~1,5 jam sebelum audit) |

> Server baru saja di-restart pagi ini. Pola ini **sesuai laporan issue**: service normal setelah reboot Windows, lalu error setelah beberapa jam.

---

## Service Contoh — Herewego/Tour_Planning_Sample

| Endpoint | Status audit | Layer |
|----------|-------------|-------|
| [MapServer](https://dev.gisportal.id/server/rest/services/Herewego/Tour_Planning_Sample/MapServer) | ✅ OK | Tour Planning Sample, Depots, Orders, Vehicle |
| [FeatureServer](https://dev.gisportal.id/server/rest/services/Herewego/Tour_Planning_Sample/FeatureServer) | ✅ OK | Depots, Orders, Vehicle + table Sample Vehicle Type |

- Spatial Reference: **EPSG 4326**
- Extent: area Bogor/Jakarta (~106.77–106.86, -6.32 – -6.16)
- Keywords: Here, Here Simulation, Demo, Tour Planning

---

## Published Services (Ringkasan)

| Lokasi | Jumlah |
|--------|--------|
| Root (`/rest/services`) | 8 |
| Folder user (21 folder) | 66 |
| **Total user services** | **~74** |
| System + Utilities | +30 (internal ArcGIS) |

### Folder user

| Folder | Services |
|--------|----------|
| Hosted | 20 |
| Umar | 9 |
| agriculture | 6 |
| mfajri | 6 |
| test_fayra | 4 |
| Training_Experience_Builder | 4 |
| GeonetLocation, Herewego | 2 masing-masing |
| 3D_Drone, electricity, HGDS, Onemap_Cibinong, pajakreklame, researchpublish, RnD, RnD_Gov_Disaster, telekomunikasi, Test, testdiky3, Vidya, water | 1 masing-masing |

### Root services

- `3D_Merapi_Public_WEL` [ImageServer]
- `3D_Merapi_WEL1` [ImageServer]
- `Batas_Kelurahan` [FeatureServer, MapServer]
- `CC_Point_CCTV1` [FeatureServer, MapServer]
- `test_feature_MIL1` [MapServer]
- `Water_MIL1` [MapServer]

---

## Proses & Resource

| Metrik | Nilai |
|--------|-------|
| ArcSOC processes | **76** |
| Total proses ArcGIS (ArcSOC + Server + Java + postgres DS) | **158** |
| Working Set total | **~24 GB** |
| Private Memory total | **~33 GB** |
| RAM server | 128 GB (18,7% terpakai saat audit) |
| Disk C: free | 320 GB (37% terpakai) |

### Java / Portal (co-located)

| Proses | WS | PM |
|--------|----|----|
| java (Portal) | 2,4 GB | 2,4 GB |
| javaw (Server/Portal) | 0,8 + 1,1 + 0,3 GB | ~7,4 GB |

### ArcSOC memory (top)

- ~250–330 MB WS per instance
- Banyak instance start 11:11 dan 12:00 WIB (setelah reboot)

---

## Arsitektur Akses

```text
Internet / LAN
    │
    ▼
https://dev.gisportal.id/server  (NAT → 10.100.1.51:443)
    │
    ▼
IIS Web Adaptor  (/server → ArcGISWebAdaptorAppPoolserver)
    │
    ▼
https://dev11.gisportal.id:6443  (internal Server HTTPS)
    │
    ▼
ArcGIS Server  (port 6099, service ArcGISServer.exe)
    │
    ▼
ArcSOC instances  (satu atau lebih per published service)
```

**Web Adaptor config:** `C:\inetpub\wwwroot\server\WebAdaptor.config`  
- Server URL internal: `https://dev11.gisportal.id:6443`  
- HTTP port internal: `6080`

---

## Windows Services ArcGIS

| Service | Status | StartType |
|---------|--------|-----------|
| ArcGIS Server | Running | Automatic |
| Portal for ArcGIS | Running | Automatic |
| ArcGIS Data Store | Running | Automatic |
| ArcGIS Monitor Agent | Running | Automatic |

---

## Port Listening (ArcGIS)

| Port | Proses | Fungsi |
|------|--------|--------|
| 443 | IIS (System) | Web Adaptor HTTPS publik |
| 6080 | javaw | Server HTTP internal |
| 6099 | ArcGISServer | Server admin/REST internal |
| 6443 | javaw | Server HTTPS internal (Web Adaptor target) |

---

## IIS App Pool — Server Web Adaptor

| Setting | Nilai | Catatan |
|---------|-------|---------|
| Name | `ArcGISWebAdaptorAppPoolserver` | |
| State | Started | |
| Idle timeout | `00:00:00` | Disabled (bagus) |
| Periodic restart | **1.05:00:00** (~29 jam) | ⚠️ Bisa putus koneksi sementara |
| Private memory limit | 0 (unlimited) | |

---

## Temuan Event Log (7 hari terakhir)

### DCOM Error 10016 — ⚠️ Berulang hari ini

```
The application-specific permission settings do not grant Local Activation permission
for COM Server CLSID {D63B10C5-BB46-4990-A94F-E40B9D520160}
to user IIS APPPOOL\ArcGISWebAdaptorAppPoolserver
```

- Terjadi berkali-kali sejak reboot (11:10–11:47 WIB)
- Juga muncul untuk user `DEV11\arcgis`
- **Kemungkinan penyebab intermiten:** Web Adaptor IIS gagal komunikasi COM ke ArcGIS Server component

### Application Error (ArcGIS/ArcSOC)

- Tidak ada entry error ArcGIS di Application log 7 hari terakhir (saat audit)

---

## Log Server

**Path:** `C:\Program Files\ArcGIS\Server\usr\logs\DEV11.GISPORTAL.ID\`

| Lokasi | Isi |
|--------|-----|
| `services\<ServiceName>\` | Log per published service (ArcSOC) |
| `server\` | Log komponen server |

Log terakhir yang terlihat: Jan 2026 (ImageServer 3D_Merapi) — sedikit log baru hari ini, kemungkinan karena baru reboot.

---

## Analisis Issue: Service Tidak Dapat Diakses Setelah Beberapa Jam

### Pola yang cocok dengan gejala

1. **Server baru reboot → semua OK** (terverifikasi audit ini)
2. **76 ArcSOC untuk ~74 service** — instance menumpuk seiring waktu
3. **ArcSOC crash / hang** — proses mati tapi service masih "Started" di Manager
4. **Web Adaptor ↔ Server putus** — DCOM error, port 6443 tidak merespons
5. **IIS App Pool recycle** — setiap ~29 jam, bisa ganggu koneksi aktif
6. **Semua komponen Enterprise di 1 mesin** — Portal + Server + Data Store + Laragon + 74 service = beban tinggi

### Kemungkinan penyebab (prioritas)

| # | Penyebab | Indikator |
|---|----------|-----------|
| 1 | **ArcSOC instance mati/hang** | Service error di REST tapi Windows Service masih Running |
| 2 | **DCOM permission Web Adaptor** | Event 10016 berulang di System log |
| 3 | **Memory leak ArcSOC** | RAM naik gradual; saat ini 24 GB dari 158 proses |
| 4 | **Terlalu banyak published service aktif** | 74 user service + System = 76+ ArcSOC |
| 5 | **Internal HTTPS 6443 gagal** | Web Adaptor tidak reach Server meski 6099 hidup |
| 6 | **Co-located Portal + DS** | Kontention CPU/RAM/I/O setelah uptime panjang |

### Yang BUKAN penyebab (saat audit)

- RAM penuh — masih 104 GB free
- Disk penuh — masih 320 GB free
- Windows Service stopped — semua Running
- Firewall block — REST publik OK dari luar

---

## Langkah Diagnostik Saat Issue Terjadi

Jalankan via SSH ke DEV11:

```powershell
# 1. Cek Windows Service
Get-Service 'ArcGIS Server','Portal for ArcGIS','ArcGIS Data Store'

# 2. Cek port internal
Test-NetConnection localhost -Port 6099
Test-NetConnection localhost -Port 6443

# 3. Hitung ArcSOC
(Get-Process ArcSOC -ErrorAction SilentlyContinue).Count

# 4. Test REST publik vs internal
Invoke-WebRequest 'https://dev.gisportal.id/server/rest/services?f=pjson' -UseBasicParsing
# Internal (dari server, pakai hostname bukan localhost):
Invoke-WebRequest 'https://dev11.gisportal.id/server/rest/services?f=pjson' -UseBasicParsing

# 5. Cek log service spesifik
Get-ChildItem 'C:\Program Files\ArcGIS\Server\usr\logs\DEV11.GISPORTAL.ID\services' -Recurse -Filter '*.log' |
  Sort-Object LastWriteTime -Descending | Select-Object -First 5

# 6. Event log DCOM
Get-WinEvent -FilterHashtable @{LogName='System'; Id=10016; StartTime=(Get-Date).AddHours(-24)} -MaxEvents 10
```

### Restart bertingkat (urutan disarankan)

1. **Restart service di ArcGIS Server Manager** (service yang error saja)
2. **Restart Windows Service `ArcGIS Server`** (lebih cepat dari reboot penuh)
3. **Recycle IIS App Pool** `ArcGISWebAdaptorAppPoolserver`
4. **Reboot Windows** (last resort — sudah terbukti fix sementara)

```powershell
Restart-Service 'ArcGIS Server'
Import-Module WebAdministration
Restart-WebAppPool 'ArcGISWebAdaptorAppPoolserver'
```

---

## Rekomendasi Perbaikan

### Segera

- [ ] **Monitor REST endpoint** via Zabbix (agent sudah terpasang port 10050):
  - `https://dev.gisportal.id/server/rest/services/Herewego/Tour_Planning_Sample/MapServer?f=pjson`
  - `https://dev.gisportal.id/server/rest/services?f=pjson`
- [ ] **Fix DCOM permission** untuk `IIS APPPOOL\ArcGISWebAdaptorAppPoolserver` (Component Services → DCOM Config)
- [ ] **Stop service tidak terpakai** — kurangi beban ArcSOC (74 service di dev server terlalu banyak)

### Jangka menengah

- [ ] **Kurangi min/max instances** per service di Server Manager (khususnya MapServer/ImageServer berat)
- [ ] **Scheduled restart** ArcGIS Server service (mis. mingguan malam hari) sebagai workaround
- [ ] **Pisahkan Portal dan Server** ke VM berbeda (best practice Enterprise)
- [ ] **Aktifkan ArcGIS Monitor** alerts (agent sudah running) untuk service down
- [ ] **Review App Pool recycle** — pertimbangkan disable periodic restart atau set waktu maintenance

### Saat issue terjadi lagi

- [ ] Catat uptime (`systeminfo | find "Boot Time"`) dan jumlah ArcSOC
- [ ] Simpan log dari folder service yang error sebelum restart
- [ ] Bandingkan apakah port 6443 masih listening

---

## Referensi

- Server audit host: `server-audit.md`
- SSH & topology: `server-audit/host.md`, `docs/server.md`
- Web Adaptor IIS path: `/server` → `C:\inetpub\wwwroot\server`
- Server binaries: `C:\Program Files\ArcGIS\Server\`
- Service configs on disk: `C:\arcgisserver\directories\arcgissystem\arcgisinput\`